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Abstract (Basic) : AU 9888326 A 

NOVELTY - The method involves extracting from a portion of one 
element content information relating to a perceivable content of the 
portion. The production is created by applying a predetermined set of 
production rules to the portion according to the extracted content 
information . 

DETAILED DESCRIPTION - An INDEPENDENT CLAIM is included for a 
computerized method for forming a dynamic media production from source 
media having elements including audio media and visual media, and a 
media production system. 

USE - For multi media editing. For creating multi media productions 
that uses content information of elements of production to guide in 
construction of multi media production. 

ADVANTAGE - Provides guided creation of production which provides 
assistance and guidance to user creating such a production. 

DESCRIPTION OF DRAWING (S) - The figure shows a schematic 
representation of an overview of an apparatus in accordance with a 
preferred embodiment of the invention. 
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>^T4«-&ttt91L?t*«. S»0«iafeb'f f *&lf- 



1 3. 



-tlvv^T" ~ — — r — "^tt: . — ^~ 

> 2 >*Jtro-bx 15 0 0<07 o-*+- 
h •> > > 3 > MrpJtA l 5 0 0 U br iBaRiat- 

[0027] &mz. h 7 ylsis s > '*k&7 a-fc* 1 5 

4tB^6loili*ftOf-T*/t^flHllt 
i-frn-t^i SOOCOfitJOX-f vTl 5 0 



La 3rffrrJ:-$fc-fe-yK3ii. b- i 
fc^*«UMI#*£S;fc*iT\ b-hfflHSCft** 
t? *fohffiz*zvYZti\. Sole, S-br**** 

1 5 0 0tiifcg^T.>ri 5 0 7£#Jr«« IV XT 
1 5 0 7 1 i (ft S:5S L , 7 1/ ^Jg£^ 11**0 2 

4«£<Ctt* ^T77*l 5 0 7iiJl£i£U 3b- 
*rVri 5 02£»frf6; 3b-*ry71502 
fcfcwc. SfifrO/J) (7M > B*lid«j7M<0* 
ffl^OvMcat-S/ii. 3t-^f7ri 5 0 2fc 

* y 7 V 5 v 9 Xhhf^h**m£$h ifcgxr v 7 1 
5 0 3#3«?S*i*. aaaBRWfrV*^^ 
7?£Vtf. ^^b-hMHjrttfflSfiitttfeiXTy 
71 5 0 6TbvhL. 7^-/71 5 1SC*$Vvt, A 

* 7 U 4 OiX *fc 4 y ? y > y h S ft & . 
[0029] -?t\ ifeE^T 77150 3 fcfcl 

<W*i«W>^*^/>5 * ?T^fc^S*ifc« 

£U> amf771 5 04t:&Wt\ 3Klt^»*Ch 
7 y s y S£«tr45feOb*r*K*3WR«»BR 
^>b'T^^r4;Kci^^v^^f 4* fcUHS 
ObT*f-+*M3i^^b'T^B*** ! i:«tntf, Xfi 
PrcvEleS:3H«EOK*«r*frf i 7 M"SIVevEIe-fe 

7715 1 8M2frfl>. 5fc4^b'T*g£ (ft 



(8) MfflPFl 1-234560 

_ 11. 

f71 5 03(C#trL. C^-CV^^r *7{Blt 

usi oo «xa-ir*fBste h5>*s*s*yAf4iKm 

T^i^-i^ '^-*yVxf v71 5 1 6izh\*X. 
mEht'T^m^b ?> 3 y-f6fc«>Cjfe0b*7 f 

.[ o p 3 o ] ae h 7 y 3 y #2j?siiTv^t^» 

Xf y71 5 1 5TH«S*16t' 
7h^y^X3>^, ^f771 5 1 6T'»«iSft.&7 
_ jf7^y^> 3>^/ViW;^^$1-^. 7>f7h7 
" yVpg>,g>^, $ fetf &X»" y7- l'5'l 7Kj5W 



20 



30 



40 



;ob^3r»*>JBtfi0b , r*K*«0»>^^ h/HmJ: 

f-/yi 5 1 7x«f -fV^rh^yx^H ya^xr 

7/jl 5 1 5^av^iitM5*^-^y/Xr /7 
1 5 Q 0lzm&. 7-^y/Xf 771 5 1 
T, ^b'T^Baiiaft^b'T^H^Oh^y^x 
e.yptrtfc,- jEiRS/tfch^yyyny (tt^t>. 

h. ?-*y?XTv7\51 01Z%L$^ ft$7,f77 
1 5 1 Hw&viTiMKSnfcK^yS/'i/ay^^ft 

>S^i*. ^T771 51 ICisivSKifc. ^ 
«a»HK3HIi. avMi^OtffcOKfflgh^yxyg 

[0jj3 2]^SXr y715 1 lt*5V>T. " 

a»|ai9i*v^.fc£su ^^^zaxfyri 

5 1 [2 V . , Sffi $ ft£ h 5 y y a y Oft«»IB . 
ifct^f7ri 5 1 1 *<" ^iiL^AiiiMffi 

s*ifc h7>^ 3 ynmmatftto^tzmmn 

X 0 ^ffii^ StfT. Cco^^li, PrevEle^: 7 h 



2*Wv$il/cht7y; 



■ft. 

[0 

1 5 



50 77 



y71"505£RS. 



S^fc. ^7 77151 



gatlVevEle-tnr bXf771 5 0 5t«»t 

03 3] mr^L^i^l^ PrevEleb7b^T77 
0 5(±. aSS^vEleSaftOb-f^KSSrifi-f J: 

3«cibyNU Jy?v*yh£?f?<xcoxj)%mx7- 



15l8izm&. Xr-y71 5 18ttV-^>fy 



(9) 



t«m 1-2 34560 



r5 



1 6. 



[00.34] h7>ifv*>£&Tt3*Z15 0Qlij& 

•TV l 3 0 0*>»#ettfc«*i*. 
[ 0 0 3 5 ] 05li* *JRHojtFa4rXtK^jBe^i&ffi 
^nt^ 1 1 0 Ocommyrrf* Atotzl MA*** 
h777^f77'l 1 0 ltfa-iftcjtf U MfHIaWfi • 

'6. <rjz % 7^orhTu J txi I 0 2^a.— mmR 

1 0 2 ti* it^iiH 3 mW4 SJ8t vc ma L fc t - b 
RMrcu:* aV b 9 >-vi^ a >£f£7*n** t^tf . 
^»SBwJEDffiWK * J^WS mxh Zb%<, \mx 9 

^•:ci^ Lv\ "20 

[00 3 6] ^^Urhrn-txi l 0 2T196flJfcA 

*x^i;rha, a^f77i 1 0 3tcfewt, x? 

•J 7 s h 4 > ? 7 >J J: ?T **L-f fiSSR S its / 
7F*ix6 J: :>(::, a— f^OSK: 4 BtJi^^ tM* tt-t 

1 1 04 a***aj*KiiT«ia{5iis^s 

T*ftCfci*-J-YEST»*lfcf, HfH*cOH*£»« 30 

: -gg<0 b'r **»tt«saSK-c«Rf 5 . H 5 (1*3 vvt 

R Bfl) (c#LTlo^>fy*ry?#l£lt^ 
6. 40 
[0037] mk<?$)iS&TvTl 1 0 6(4,. MffcMR 

v hT'y 7'^-r;/7 ; l 1 0 v 
-fe.-y YT ^/^xvTA«ftcfcCJ:9 "jl- 

-tf (iaflftft^rw f « . ■/ s 7 v r 

^f771 1 0 1 fiis^T,. a-if(44fcir^) 1 x^yr 
fro-feXSraW-f 5*\ &^liltc^tHZ'O\^XC0& 



L U l) i 8 J y Ml DZ bnN.Ar 

y?i 1 0 z?)im%7Kf. mwAf-s? 1 2 0 1 1 

7 T 1 2 0 2 *f J X f lz$> l £T OX 9 » J 7 s h 7 a * X 
7771 2 0 2l±7,?.*J7h7n-tWJ A btftfM 
Xftty V 7 h A«»7 L , N O T 

6*1.6. L*»L. ^f^71 20 2(cJ3^T4«f 
( y^h±0) X?V7b7a*zX?)®m>!&h 

^3 tf T tf ftfc^^V->J^'7'n-feX6a[fflt'<S 
fef771 2 04IiJBfl|LfcA^y7 , b7 , D'b 
X^*iHI^*3t^^T--y 7*1 2 0 2^-r^^ 
t , *S<-i4JfiSii3t7.*x^ »J 7* h*s*5a 1 1 0 3 <r> . 



[ 0 (j> 3 9 ] ZZT. B*<?Mft4 O^fe^lt-ttM** 1 

y Vr^fl^ttSTft^ftfe^v^trr^x^ y 
t'r^> y 77^^-A^i/^ k ut, 

aaiF»a;'r*aHijto^Tj8HBr * . 

[0d40] <b«h™>EI7i5. b-h210*^ 

(»±t:T5r)"2i4i^a»t-fH»iMtjs^. - 

«W(i,- t-h^}$$iixt*r*^ , J7r2 l4tORI 
RBCC8jraS/i&S^h7"/^2 6 0W**Tfc*. b- 
h 9 v ^ T« t ^ix&^^SSBW* b- h 

1 

1 

1 



1 7- 



v mis Fcal "TxraVT X'£>6C £3^St5T V»7>\ -pr*h7'y 
[0041] t'r -/7V.iMI8!Sryi3Ht4 b- F<9 

5 ilfc»9U* tf> 'J - FX y *J&&a+t y — FX -/y 

£Jff£cobx*? y vrizmm^th b*- F k.LTfflw " * 

[004 2] H70tfr*^y 'yT2 14«. *j&F.7 
■y^Jt'-F tH»!Sr]R5'<< F y 5>-^Sil4«M). 

f y.s v^.sar ^'iv>b*r*^suT v^.*we*3„„ 

. * F y 5 >^tr^ 2 1 4 iib'f * 2 14<m 
£^-VfcaJS*S3o^*?x3>20K 2 02 

K7>>y3y<iy-VrA'7 Mf ^ 7f^/ (bu 
tt editiae) LTttfttTV^.: -tfciife. 5l#*-iVF 

[0043] *h'J^^tr^-t;yay20 

Sftfcffltzfcivs. *E5rtt2 0-1 At f 2 0 5"6r$tt 
To£ c *Fy5>^ r t*r^204^F5>'v>'s>2 
0 4(i#FF5-y^2 0 0^t-F2 1 Ok^&lTU 
t-V \ 5fe F y 5 V/t'f^ 2 1 4 OfltOO-fe? x 3 y 2 30 
Ol'tt. ft^ys^l 2.feOHK#^F5yV2 
1 .00 1 - Ffc-SWi F y V/y s y 2 0 3 Sr^t* 
Jr3*-fc^ 2 y2 1 ItcFy 5y^Sfl&. IrISK. 
« ^ O-b ^ y a > 2 0 2-at tf 2 0 3 li* ft? ii-b ?V a 
y21 2&£tf2 1 3fcFy $>72ti, *?is3>2 
IK 2 1 2. at'21 3^iOF7Vv5/3 V^t^ 
F9-/^t-F2 10tBMI-r&. h>J$>7Ztlfz 
J z?is*V2\\^ 2 1 2ai^213(iBHLT, 5/- 
> -**M ^> F'Xli£ffc*>Hlo F 7 v'tsis 2 y #WF 
77^200 Ob - F L fc t'r * ? y >y 7* ( Xti 40 
tr*) «B«W"4. 

[004 4] H30Ar-yn 4 13X'»9JLfc"j:5 

c t'r:*£Fy sv^u Fysy^sn^*-*:^^ 

OfcV)a^*fc7^-2%fcl*4L."Ci.ftv\ L*»U * 
M(^tl^^BNfcWR'l*k:«:6 J: 3 fc7 



(10) ■ / " fMPFl 1-234560 

BBE* C*3ft4 b> FO-&-.?"C<r >iMr 

[b<j>45] Sfcfc, h : ri-2 145:^F7*y^20 
0fc||lJHStf4BL ^F7-/?2 00>b'T*214 

i Vf^Tt- FOB5BliaiBISr«a-r6jB15«^ F 7 y 

4 .1 k b # r*OX K*««t 4 £ 3 fcJSBfcff 

* [oj)4 6] <F5yS/>s>-a*at c ^^ 5>^»H( 
>-jflCt*T*7U-i,i/-F (7l*-iO#) 
-*r*6frft . fr*tibMt6Bfr*07U-^»»i« 

. 1 j: 9 x h" y k » 2Jb 7> 3 >-|BI^«BII5IHLJ:«r*> 
*)h7Vyy 3 ViSttt F 7 ^ x x 3 VKftibil* t'r 

/.aicffiirt*. F7^v^3>i5, muz 

' ifii'kiii^. 20^-b^xH FXr 4 -/ F 

4^4->^*&£F5yx^=? VT'iv*. L*»U. F 
rFfey^gy^Skv^feWSaftatfRtt-fiJ: 
j*Sr*trflfeco F 7 > V> a > .«5tfc i o X fl&fM 

mxzm^x z$:t &it 4 . 

[Ob4 7]ff4Ll^*tfi*?Bfci5V^T* ZWXotzh 
y>^> a >^^>f = > -^at f x tr- F(i, T^Sa^fc 
5^^7-y^kRI.»!S*lT^y, b'-f*7l.-A$:tg 
ftftac%*T'S4Ckfctt(ttf. b'-F.HJB(C^ 

yy&zsB y^e-Faffl(iattOBrS<0b # -F'7-* 
-c^^t Lfc F 7 y s/y 3 y^ifrt s ± 3 fcrafl 

MS^i4. ^LT, bSyyys^tfttfifcft^) 

v<ofc»7 A*f» 2 owjeo b v f -7- * - k-a. 

LT^«^k*iliitS. ^h7yyy3yliSiE 
IBr**i^ii«0tr-F)^at6 J: 3fcT^y^"f 4w 
kClioTit^$fl4. 
[0 048] <#^VN/UOWa>H8tC. 
y^F7y73 0io^iy^;HW^k. ;w^y 
^y^F7 -y^k^LJi3k-r4b'7 r ^^y 773.2 
0-322^~jr>xi^t. H8O««3 0 0iig 

3gBiias3 o o r*o . «««iT^«-assiifc# 

^U^S: Ly>LTV^4 (S : H S «-SOiB^-CIEa 
§iif v^v%) . b'rtfa^o&vMBfKS; «akt 
tKrlftEK-CSiikT**. L^L. MffftSrWJK 
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19. j 20 



->fc«fHHSflBfitea t t'Tmm&m i x ± 1 v> 
[0049] *aw>tfatt*twfflci3v>T* try* 

* U 77*3 2 0*>fc 3 2 2^ia^h 5>>^a y*i£S> 

if h'-r*^ \) v?3 2Qlzni8tl : ap\s<fU3 0 3(i 
-tfo-rv^/t (OdB) itta}3ix. t*T*?»J7T3 

2 1 izmt^^u^)i3 0 4«an^fcttassA. - 

1 0.0dBfc:-fc*vb$*i4. b*r*^y77"3 2 

2 *i| t 305li-3dBfc»ittS*l 
I). 

[oo so] mmit'Ttzmtm, hhtv.i? 

*tl*'il0>#4 > b 3 1 1 tefcV vf , ^5|^(¥^(r 
amping)3 1 0(Cjt^Tft«»Sa»3 1 3#£j£Sft 

* . mm^\m 3 i 3 #4 L < a trr* 3070 

^7*^f-7 7 ? k LTttBJSii& 1 o^ftkLt?) 

sw* o-se«M^ i 3 , ^'y * y y y ? teas 
5fc£. iL24*i*«at;:ii. 
<■■/ * y ^ b 7 ■:/ ? J; o TH*«W t * £ $ 

[00 5 1 ] <#F^y f->^>jif£ Li^BtBBJBtcfe 

ftfcSn<0*Ffh?y?IJ4fc. »t?h77;^ 
oTftjg*4>fifc ; UK6ttc» 1 o«m b 7 y ? k «« 
I fcff i* b 7 y ? ^t^&WHffiiefflv >ft d fc 

.Th^a6£iftfefifc#j*b5y?tt. BKSftfc 
r »lof?rh77^i:-a(:, «^t«-<D»b»Jfc:ffiv* 

~& i k #t*s * . b ? v?frt>mm%Fh 
io«f.tt k tm $ nfc#*^r b ? y ^o^m^mmz 

. ttttlS. t-b&Ml 
jKSSa(dooinant frequency) kV^o£iW9#ifc4£: ' 

[00 523 J^T, £<WFVyf-y^^O#t*T#SI 

f*. «/Jf, Sit^4>S«$#U:^l^b7'y^ 



9 

[0053] <^®n >r> b k 3 > > t'-r^fc 

*>\ £f$£t ft 9 k Sii * . 
[0 0 54] PJ/Jf. t'r^-fc/XVb <;'J7 7*) k 

I— 1 5 0 3 «0T ta*Stifc««X-Aik k «: t fc« 

[0655] mx-j+it5 0 2i^ 

Xli^HS>|-ii6Ck*<, «1*X-Alfc502t«i 
[Of) 56] »*{fc3#ifc* h'r^^X 

[ops?] Hiott, /Meoi^t'f^^y-^ 

>-X?)»i^ftyt>-£/ a . y b6 005-^t*. 
$ffifZft*£tZ>ioizLXl&<, *<?)tim*>*y*/ 

30 [ 0 f) 5 8 ] t'T^^^^X-AatO O^ u v b«aS 

isit^^co7 issMi ft/>-> v 3 

. 7 h^)A**»Lfc9-f 6ikSr^Ittfc-r*ft«>C. Bf 



tf, mS7b-ASt=fc2. X-AH»*3k-feyM^ 
2 7lk-AJHrt-ei : 3tfiift1§J}X-Alt36««t'J- 

40 [0059] nvu 2 y hX«X-A*«0lffl 

X-lte-e-^Sr-fftCtt-cSi. L^L.^-y^g 
7 hi(iX-;><7)ii^ r^t^C t r.^l:7-^ ^ ft 
It4*tau. ^HiS/i^X-AaK/^teWfte^jBai 

[ 0 ([ 6 0 ] <Ep9Jtc i *. tV* ^S»>y<y y 37b 
50. f^^VW, EDffl<0}tWz93JpJK»tz|JlAaSS 



. 21 

"ft: Kv*Tit'r*<o:M xri:&&'9btiMiefo&Z 
ft£ t'rtfco-bXX >■ b 4rSflfc:aB8W--6/wA^t<Ot* 

&i>*ft, t&bfe. 7U-A4«:-&*$ji. 01 lie 

t*T*0#71*-AOffr£3>lI« (picture) K*Ob 

9 > ^ a > ■ $«ajT6 c fc iz& o fj *) c: H*v% 4 . 

[00 6 1 ] 'HI 2I£ V ttaWUfjklf (salient still 
image) 7 0 4*»4fcft«K t'r*£)7 U-A 7 0 1 
-7 0 3S)£l£S:iiU/CV*4. »8»S?OHf*jfc*> 
0»afl9»±aic*«S*xi 7 V-A7 0 1-703." 

#*U*. HI 2 (C«5fl& 30^71^-^7 0 1^7 

iLB7 0 4*£filW4t::li % 7ix-A7 0 !T*5ft4 

Bftttfti&ttffitB7 0 4^)* 1 U#7 0 5 J: LTfflu 
6ft*, HI 2lcfcUT^$ft4<fcoC::. 3515fcfr7 0 
5l28xftiO«#S»f\ 7W--k7 0 2T«S 
ft*^20iiS*S2^ e e7r^^TS1§L; KttS 
ft/:'B»&«rBftWiLS7 0 4O*2»*7-0 6i:4* 
J: 5 . » I «#7 0 5fc***Uif»A*ft4. fife 

7U--A70 3tfl3ft4»3^iiWJH3a*7 
0 7>*4Jt3. JB2«i»7 0 6aBI (XtiifA) ? 

ft*. e*>LT»4ft4»att»jha704«a»t6 

fiTifc«^*fcft , 1 o*>fctttt»jtH 7 04 
4£ift£*l£$ftfcBft7 0 4<03o^»»7 0 5-7 

o 7*^«tt5ft*.* »ett»±B7 o 4iiw«Bsa-c 
[oo62]^3-y b&i*x~Ax-ryx#&m 

tia X ^ 7y^}f^y-^ &i yXteX-A Lt^l 
"#£"0*fct>4>fcffi*f4i:. -tOt'r*C4J»-6^y 

'4*IlHfeMS>4. ±ot, 01 12K/1 2£#*3LTIft 
■HLfcJtSK:. *ft&OKJM*5^:o*fcll£ftfcBB 

tfm\mx*mmizwR $ft * . 

[00631 ttObr^ty/a v b&tf/XtiX 
-Ay~^y**^rv*4i3ttT1i*oU /^yXti 

4. ^OJt3«r»*(ctt. 9J»lgSt'EPSi]LJ:5ht4 
t*T*<0B»li* 7*- ax. xn-*- 

xs yfy — (slow motion blur) Wo fct'T^" 

tJ>-><v*<om$>Z>m'CW± (dc-X) wro. 



(12) I ^63^1 1-234560 

: ■ 2 2 

!fcck*>4._ 

[0064] <»S^aBR-Sftfch5yy^3>*>Hl 
3 »i I ff 1 tTH' XX y b 9 0 1 2 t'r 

^-t^x y b 9 o 2 ia^4«33» ? p b *>k+. 

ftafe#bTcSftfctf7 f *-feXX > b 9 0 1 (£&7<£X9 
. 0 0 feTW:%i&fZm *: # L"C u4 . I^tSSli 
3HHSX9 0 0O*Tflic»S ^ WHO* 1 -t * b 9 
0 3" W<5"ftTV*4 . 3e5^IE9 0 0C3® 5ft*:3»2 
10 t'rfr-t XX y b *£it -J" $ M * ^ ? ^ ^ ^ 2 * b 9 
0 4 (L * 1 &MU 2 O t' XX > b 9 0 1 m9 

o 2^iat*s«X9 o oo*Tft^asaH9 o o 

[o{)6 5l ft-Vt. »iat f *20tr*-feXX>'h 

9o|iatX9b2*ffaaL-c«ssft6»^t:u. b7 

yy> 3 y*>»4*WCA4 . if 4 L v ^ttSStc ± 

fttf 



fr^-t XX > Y > m 2 t'r *-fc XX y h h ^ y 

[0p66] 01 4(1, Ml 3^f-r^-feXX>HC*t 

>'4s>905 t?i V . % 1 h'r^-b XX > V 9 0 
1U^TVK>'->''C\ &2t'r*-bXX>'h9 02 
ttXf?<5^-VCA4, t'r^*tXXvh9 0ia 

^9 62^-Fft^ft^i6^^^^. assatc^^ 
s^At^o**?* r b ^ y v v = >*auft«c« 

30 ^^y9 0 5iS«B#iOaatSa$ltrTr f *-feXXVh 
T^$t 4 » S 4 * 2 tfT.i--fe XX y b 4f» 

^ <; o t «s^a 9 o o zmw^x \ ^4fatge#^a 

&S^if*Stf4. b7y^'ygy«a:iit'r*-bXXy 

(ffti. *J6W«IEBatf*K«r«ft4Ck*<, ±^ 
OHiWfc 0 £ 2:4 V ^ v tyjffi&n b 9 y s >R 

if b f y x x # va«fc«j&r 4 waswi oft - 
. 4itiiv^*Tt*vi. mm. mtw&tf*Mm 

40 #^'^0 . f ftmy*'DWCea$ftt^4 2oc7) 
t'r^-tXXyb (^»J«yr) ^«ttt4J:3*:«*K: 
\±. *2t'r*"feXxyb*7x-H^yL=5r*^*l 

f ri-txx y b i 7 x br^ br4 b a y 
t^riBT*4. 

[0(J)6 7] <a5?-ayTyb>»^HJS^S(cJ: 
4, B«03y-f-ybfc:a^<j5ij<oe»»*xa-bxii 
feSfkT'^4. tLJL-^-{-9Lfc«tfttf. 

xx ^ b < tt t :r 4 soma 

50 9-iyf L ybM«t:aS^v^jBRi to 4ii:* f T*4. 
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MlC0£ti, Wilftife<0*^(cb«i'ltnientary set 
of colors)^{ifiS.fe^fe'&(suppleBCDUn* set of c . 
oiore>*^B«W-4 £ fc & . MfeOlfr&XttMft 

*;:fc**<f4U*. 

[ 0 0 6 S ] 0 1 5(34, BAl 6 0 0 I . *M>JtfcM 
ia^iUf TITLE" k^3:£?l 0 0 1 fM$hX 
1*6, Bftl 6 0 Q14IWBHBL %7fimmz&jk*tltz 

«*»S«LTiv\ to 
[00691 1 1 5 tliifc, *t=.l 6 0 1 Wf«* 

6 0 2*$J:1<$£&<0&£1 SOJa^SiVC^*. tf 
£16 0 2 Atf /Xlittfife 1 6 0 3 ttBft 1 6 0 0 CO 
*?-3>?ybfca^*aJl«i*. 

wfc#T*£&. 

[0 0 7 0] Ell 6134. ia^7-3yf^h^ : 
SsO»«ffiO(i* 5ts£v\ S^S^ 0 1—4 05 i) 
£^4f<^B4 0 0#S$ftTv**. fflitf* tt 

ftfeit*«rtS«OT*Wf, 4 0 1 &t*4 0 2 7?^* ft 

&«hb*»4* 7-3 > r> b sn* . raw 

<0»»4 0 3.Xtt*£>aWM- 0 4 "CR^'StLS^Tftn 
. tf . w*i4>^lBi'**h.-rii^»»4 0 3fttf4 0 4 

[ 0 0 7 1 ] ifc. XaMWH^+ifefcEliSfiS*^ 
<4, HftW+*S4 05*»fe*5-r3>'T>'HSIR* < 14 30 

it 5 . fd * ft /X(i;5f 5 - n Vf >■ b tS$B*i br-t^ 

[00723 *»^M4jBBBBttift, El 1 7*1 

-^*rA1 7 0 0T*ff*ii6V7b^7fcLT . 
$flA&£ft£. nyta-^^fAl 7 0'0t43>tr 
4 -^'aHH70h 7J3&B1 7 0 2. 1 70 
3fttfSUSSBl 704t#LT^S. . 50 
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bl 7 
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707 
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[00 



"IWIPPl 1-2 34 560 
24 

H 7 0 1 I4**< fc 1 1 o*)7'a* -y y 

o 5 1 > - «wt*»** > -/at 9 * -J 

VI) Xl^y-KsryJ-^^y (ROM) 
i;jL--/b 1706k. t'-f-jM >^7x-xi 

*, ? 7 i 7 0 S **trAA/Ul* ( I / 

^^f-.Hr-r^^p5 : *^ CD-ROM 

0 1 fl»JftB*l-7 0 5 jK> 1 7 0 9(4. «SJS^U 
"&tfl*^Xf A 1 7 O 0«i»^ttf^a*k tTft 

ftfflklLTfcL IBM-PC&tf**)5S». ^>'tt<7) 

[007 4j <mxiw^>m i sis, J4?ic*^a 
'21c 6orn-y^iaT*s7ffi»iR»«B2 i 00 

b«Sp2 10K *SH»2104, >*»JE«3S2 1 
0 3^ a-fW^7x-^S2 10 5. K#SL« 
ffi^iU (ROM) 2 108. b 2 1 0 6fttf 

[ 0 Cj) 7 5 ] ffi?iJCft (^r^T^^ ) ^S2 1 0 0O# 
^ffl^jCtT. afl^-bSrl^iL. Ett»2 1 0 

»4ffa^)^iaa@Ett»B«=B*SliT t ftv\ 
[ 0 J) 7 6 ] (Av^ttlRJK) 8*ita*ffiffl4, ffi 

b fflf^J^WlKB^ASfi^i t T« i w k « . 
*U3-b\ *r-fX?F9>fy. *^»*»B. Sffi 

fl3S!i**tr, JR«3yTybl1WBJ43>'T>'bT-^ 
$?iL<tinvrVbT-^*cKil^^^^T 
-^.tt*tr. 3yf-vh7?-^o«kL-CI4. t*T^ 

*>'baa[-ctt»'«*ifeffl»f f --^'c*9. raw** 

[0b77] ny^ybiRm^ (CCU) 2 1 0 1«4# 
* I < U-tii-PiUWSBaon vr y bffifS$rgfi 

(JR»Xl4?f*Art4 ) wfctfnltefr, M^yfV 
b-by*Sr*r&. C^^^-fey^MkLTii. * 
( nvr^b) ?n7*y. if ft 

r-^CIRffl^iKffla^RT (CCD) . iRft-f *S* 



2 5 

T-?CKjS1"4 74 r-r >?3>TJ is?> iXfr 
-9) Z$^l*^?*t8h^±>*r%'istt. CC 
U2 1.0 U}^zm«<D3yTybt>v^T*fjj 

[0078) a— f (ii-lf^ **Vx-xft2 1 0 5 
£S L -CW^rttt LT* h Wtobtri' a >7* 
U-bfrh&%< k & 1 -^*jBRt* . ^L-if ia«* 

2 1 0 4 JiX * U iefgS2 1 0 3 &L C /X( ;R OM 2 1 
0 8 k 913 L«« . >* 7 x -X-gff 210 5 
tltlxmWM8m2 1 0 0T9ft*SWrll^^*r 
ysH-fvrk-bHSRn. _„ . 

£f HTlE»Sft.4 £ k WKfyri/- b >r > x h 

a«3tK21 OOaWfrfCfeHnU Java (^y 

f>7P- M >X h 5 ? >- 3 yimfiX- b 2106 
Srtf LTflUBsyta-^vX^-i^ 1 0 7A»f>J£HE 
&£B2 1 0 O^T /Td- K$*u **yEtt«2 1 
0 3KE«Sii4. 

[0080] -IRea^tfa-^y-ACttfflS 
» 4 b y '-> x> *r ARtf/ "Xii 7?7yaA 

-HS-f>r^-KflM»:ttfflu jdaiaftRB2 1 o 

-b-f vxh^^y 3 >»- IB, #fcvi<oA»*)TV 

r btasKr-f yxbyfissy* L-$m* 

*y2 108fce«U **yEtttt2l0 3fc«Kr 
(RAM) ^*y^S**W^4Rfcr4wk#ffi 
Uv vi^J^^LT, t^'tv-M ^h7^i/3 

o 7{i3>r^fff«s^>D-Fr4Bfca{*4 v 

?7x-x2 1 0 2fc4 v*7x-;vr415»05Ml8S 
BkL/ti(^S*i4;rfc##4Lv*. 
[0081] a—f>f y* 7 x-Xg? 2105 teWifcf 
ffiflr-fxrw (LCD)atfayhD-^Vo 

(ZZtLhCO* -y-t-iSlZtf&tZ*-? AJKOMmZ® 

[00 8 2] 9smtt2i0 4\iTyrv-b^yxb7 



(14) EBFF1 1-2 34 56 0 

2 6 

*^ ^ v» * tajRK Sr**2M*x-y*» <■> <W - jl - 

*tH*rS/ff>-fc«R-f4. 
10 08 3J a^UJt^aR3il4iSRBBi. CC 
U 2 1 0 1 c03H«, a— fry 7 r yXB£Jktf/X 
ii$&m%&2 1 0 O-WtfflS/iJi 3 k IX^&mE 

^x^WKojWi, Tyru-biffiStfcoyTyb 
ft Wfr'^aA^aE* t , J: oTCC U2 1 0 1 

Hiltf, «TC^^4E5g«^«S^lMI^S^ 

4 k v^flBfCf 1 b «BV*"C *>&V*. 

[0 0 84] B2 8«««^^ttSBIf^*t«t7 
_ . o-f*-b'C*>4. rn*.^ttXf -yT2J 1JL0 - C. 
MM«-4..x^ryr2 1 1 0 2£^vt; 'J?%<ti> 1 

20 4 . Xf ■> 7 2 1 1 0 4 C&lVc . fcSgJESSSSKfcU 

4, |xT*y7*2 1 1 0 6T'(iT y7'n-^ji^fyr 
Hb<0r>7P-M >Xb7?X2y#H?T$*U 
Sfl^Lfc 3 > r >■ Mt«C3W< r< >'X 
J&V4tf£l&*iiZ>< Xrv7'2 1 10 8TU3yr>h 

56?k4.. -r LTXr /7*2 1 1 1 OXm^J-r 
. 4,baS*lfc3V^yh««*rE«#a^OEtttW 
■f4|£-Kt:*tfrk* f ff4L<. afcEttSfufcavf* 

30 VKffifgWai|IS^^yn-K?n4 e l:3{cLTi 

1 0|08 5] <^1^5fiiR^a>JilT. JCR^-rr 

^*!(0«)aai2i oo3&»rt«s*L4*». is^^xt 1 

A<o^*B*Lri^4Ty^x^*>9S:WtL 
T % j»10j(BarafciSBft:-5ViTKW-4. 



tfc^"C3yr>'hiR*a2 1 0 l*i^coS^^70 

40 -y^X-rA: GPS) >«fifc3& s TS4. 1^4, 
O^jy^t^gli^^-xT-^ao^iS^k'O 
^^jT-^SraS-f4. T<^;WXf-/^^^i0x- 
if>fiy^7x«-x^2 l o-5*ijBftr-f xrv-f (LC 
D) fcbD. ff*L<lia- J Y^7jt-X*2 1 
0 5|ir-^A^S (Witt, ^v) **tf. ail 
*-h2 1 0 6iilO^iltU:O^^TVrU-h 

fcinp3yejL-^2 1 0 7*»^>rvrn-FL, 

yefttf 2 1 0 3CE«t4fci6fcfflV^h'4. 
[0p86l'Hl 9J±T^^x-J-;^^5(cJ:oTa 
50 9*12 2 0 l<W*t»oTVi44OTt^SWBrc* 



27. 

¥>9>\>A*>\'**522<O2\i*0>^&\Z* im 
SiUBBW^SiliLc D 2 2 0 3 & tt£. 
iTl5K»^&li»S:^-V 9-X9> 2 2 OSCOWTtz 
£->X£tK't'hfr. *«-Y*r>yv-Y*$9> 2204 

Tfc J; oTr > TV- K*- K<0A»*Tt 3 r 

1 0 0 8 7 ] 02 0fc5tfi"d"fc:. ^>7-^-h*>> 
2 2 0 4 *trFt& 1 LCD 2 2 0 3fcfiWTTfl&5:7*>' 

ru-b23oico»jx htfwmtib . *mmmz 

-feU?*#*>'22 0 5»i. ^^SiREcorS 

Ffl$il£, LCD2 20 3"C«*StlfcS8?rn-23 . 
0 2 (iJSaor yy h*- Ki!HR*5R1\ 
[008S] f>rU-biOM, fcfciKtf-M'- 

ta«* f ara«2 1 0 4?»ffa*is.- mmmtry 

[00 89] 02 Ki^-hU-hr>Tl/-h*«BR. 
$<l^f4iOLCD2 20 3*«-*-|a-C»5. ^ys- 

4Rl**> 2 4 0 5 tftov^^arB*** 

iMtfwKK2"2 0 3(c8ii6 wiifetf«*«i-i>': 
ifiis* 9-X9 >'2 2 0 6 Srff-fC i: fcjt otli^) 
IEfte*»3fclfc$*afc. <4fcliE»Sft*B 
ft)<?)±tC3Kfl*^. tfs^gXy^fVS^-7 24 
0 1 . 5-Y >-T v 7^-^ 2 4 0 4 IS J If* V 9- V- 
^> 2 4 0 50SftOl«M*4&Sft:, ttOttfflifcHff 

.*4*i*£fc0«4U\ Hitf 
-*2 4-0 4, 24 0 52«f/ifcl±4r^3->'/-f 
>^-^24 0 1*jEL<KWLrJ3fe'f, a^f^ 

*jWtt"Cfc&*S\ 2 4 0 4, 240 

3 yvir-92 4 o i nmmzmtz . > 
^-^^asMteBtftoj: »>#4 L^mwmatt 

itxmmcomzw mtixi£\,\ 

[00 9 0] #4L<tt. BftRlfJtJ&f&^^T*-^ 
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[ 0 0 9 1 ] tf^x s yV^-9 0 

> S/t-*±tfK< l J 7 x v)V7u- 24 0 2 

>■ > |- * 14* (fid L x~&<nr V*M X £jl-Wz 
VTn-2 4 0"3tiB«^ ; 5*2 2 0 
l^:C-A-Y>'*«a4Lv>ifcS:>jW-. fct. X-i% 
T^#S4 U^i&^fcaklcX-AT* hTn- 
2406SjflB83*TtJ:v\ SFTf*;2 
20i3i»*-?<52 2 0.2S*(=aW(t** , aS'l'tT, ^ 

[0)92] -b>^-V-^ 240 5&t c 74 >TvT 
v-£24 0 4ti, B«03^-fyM*WO#ffJHfB 
«Ui<^W*2 2 0 1 OJ34lJ:*Otaat*»«fcttffl 

, : > **ariE*rna* y «■ 2 1 o o t*t * 

[ 0 b 9 3 ] mW>V&»2 2 0 1 <^£*«rfflStftlB 

1 0 jo 9 4 ] JB 1 *0ffiiRiR«KK?)C x-x g y 
tipT. -feV^-v- r *24b5tt^aflHW)t'fr 

9-fyr-yrv-*24 0 4istta}S#ifc«9««o 



Li 

7^ 



xr-y 7 s -7-^24 0 4fc-fe>-^-^-^24 0 5 



[0 

J: 3 
#4 
24 
20 



0 9 5 ] H2 2t*Sii*J:3fc, 
.'l>rn'^2 4 0 2Ojj»S*»jhA* IL^*ftt*t 

9 2 202 «r*ar*aie*mt:Hti t ^ 

04fc2 4-65«r»a8***«B**<, 1K?fr2 



V70-2.4 0 3/,<fiSc^t LTX-A-f >*aiii*i 

[0096] H23I4. JL-WjEL<BakOK»*2 
20 1 *+-McEHU X-A-fVtff*vv 

aJt/iSlr-jr 2 6 0 2*<LC D 2 2 0 3KSl^$*t£ 

• a»l3iifciF'vri^-hfc:«-7TB» mm 

50 7^<-hLT@{££aim>. 
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[00 97] I3d24ii. f&&to]^f*#ioiD£v>g 

^rv- himm>mtMmzmz> 

**to*iS# V^XO«H1W«i1KW^*2 7 0 

^r«ajp«S2 2 0 3) <0»1#W+-Mi*> 
-?-A270 1fcLTffilB*ft$. Sit. ffli!B» 
-o^ajtfi^ffl^^JS2 2 0 3c7)^HitV^^ 10 

BUHSftS ? >* Kx7-rr >rv- ha^V77? 
ffl$ft&. f!S'C«tt«rB«^Ajc.. r>--2>- M* 
-fit^tLTH^fi-CSfc* 5 , fVTi'-Mia- 

1 -yfrZiiVlknryyu- Mi* **fc*f*£Si U 
[00 9 9] f-^rU-h^^^^^r^hfSffl*^ 30 

ai,< »?t*<oEa<or i^w z t Wf& z t ¥tz . 
[oi oo] wauita 1 )", fvr^-Mirn/? 

MM»«»a3Wf 7 *«*asr *^fc«H8ft*«* 

rT- < LCD2 2 0 3) 05B«SrWff*"&. 
[0101] jr-if^-f yTV-->^-HS^^^2 

2 04£?p^i:. ^SWr-fy^— h***3«?ft-*t* i 
-iflifta-f Sr^r u- f- ? > 2 2 0 5 J: 

£1*7*6. 3HR£?t3B. aj£A{:*ftft*««3- 50 
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F-CRSii* J: dfcV 7 h*7x7A— ?-> tft'a-7 r 

yf^H v<0*x -y 7 Zfr o . 
[0102] S^^ForTeiirIate^7 r 'l'--?">Uaa**S 
5l*|ftTl*Sfc&K^^B*jEU *4 >ro^ 
A^VoidMain(>**®« (t?**) A^SSISiVC.OiJ: 
Vo75i/£i"C&* 

[ 0 1 0 3 ] flifiU: i 3C *r-*0>J: 3 Srttfln 

ft8pJI^)ftlktTli. Btt„ »H. «ffl*ft*:<- 

V* -y 80. HikB#A«KO#-- h 

l^-iKCfi**\ B«<0*<OA»tf>8L «£K^iU:^T 

[ o| i o 4 ] <*2 ojhwh^ji> Jarca^* ± 3 

fi|2 1.0 4iW£f ^i?* 5.^1r»£.aiS^ c 

f7f^>; -y70>C-A v /ty. -^fiJUit^aiffi (ttB* 
BtiBLT) rt7F/M**tt*?**J:5teft»Sft 
*.|^tf. fT^A>5A.O7-y7n-H<0fc*W). 
Urior -v ra- K^rig^'r V7U - b *ra— »f (cgft 

S^S^OHJ^SJS^SBfc&AA'Ct Jt.v^) rV7 

[9105] ftftwtii. tfttmizju;? b^ffi 

5Ud^^Xr^2 1 0 4£*-f6fT**^5SJ*oT 

&tf^JSB^5K«r«a+4fe^ *77»J*C0»* 
L^a*c7)^y7l/-h*ttSliRiaai2 l 0 4^7*y 

^aatSft^BUft^*^ (Mil*. tT5 S -y H > n& 

[ d) 1 0 6 ] jsosjowk . ms&tois'-y 

fi/t:^07 F^J^x>-r I— b (KIT. »> 

x^m y/f^rk- h fc-r* ) o*#H;:ms3ftfc u 

2 i 0 4 fc.frf 4 b'r^^ 7^51^- h 2 1 0 6 * 
^T7y7D-HT*. ^XT^y^r^P-Mi 
(^y^-f/y.Sftte) 3-KfcUT-X ; 6 9E18^a2 1 
O^tcIES^ft*, 7-/7a-K^ri84r>'r^ 

^ ^rfiBKJR^aolQHIK:^ oTROM 2 10 8fc 
EttSft-TV^. HR«IEWi. *»«'hatflft*X 
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[ 0 1 0 7 J ^WtTtV^-^-iffl^t^xf 
U •/ 7 £ SI * fc» fciiB I, *r < T U * H«e v > A<0 ^ 
+4 v. h "/ h k. h i> tf£ L < fc»* flttC, t£S* 

> 3 <y h * if*H»t h X o icffiSfi* ♦ 
[0 108] Sfcfc. /tzy*\ 

[01 0 9)tt±L<li. t*-7T^yr- (LC 

izmmh immth) . ma». ^x-f^^fv 

7l^-Mc*>ivC, jL-iflcJitE«)WlB«r*i^^4 

^aEs^^oas^ifeii, transit* 
v^a»flwti «au&aid»»£fcB * ft • «R 

( : f P r ft 1 1 £ Z>tzWfairzT-9\iX9T-9blX 

> Lx^xf^> -/^-^eiEasn*. 'ft®?**:* 

mzte^Z. V^?4>?is-v\z®i&Ltz*9 : r-9 

[ o 1 1 o ] <c * 3 ^K?nzmKa>® aafttanftg 
Mz&iztb wz-fRtwzmm ztLi. as*f-+*^wi 

[0111] ffi^fcttteto-K. #66*2^ 



(17)| . IWPF1 1-234560 

: * 32 

i7x; hazy h^c^ax^tis&^-K 

n*. 

[0 f 1 2 ] H2 314. S^S** V?r&9i'X?J« 
2 8<>0£*t. *J*S*^>/f A?y*TA280 
0«J S^S»S»oa4:tMa^3>^> MR£-fc>*2 
10 8 0 1 > . hV*hW&m$tm 
28 )2£, t/UB3yejL-^vXr^2 8 04h. & 
&<9X7x7b3-Xy K 7 <fr9iWRtf71'J4 
if 281 Ofc. ^<^felO£Oaa^7K-b2Sl 14- 
#tf B*«lBB2 8 09fc. a^nfa?CD 

-7kz -y h ££tf ££&S2 8 1 2 L T . 
_ I 0. 1 .1 3..] * 2 8 0 1 Rt/ffiOjBSLtSS 2 8. 1 2 

iDUKfllW Sr 9Q«^-«i£iMflZieSStt 2 8 0 2'^iSfcfi*. 

U>^2805(ziot. &^R£g^2S 0 2^7 
•y Tta- F 8*1. SS» 2 8 0 2 17>^ ^ U iEtt«K!E«S 

Si*. J^TOPaEB2 8O.2J40l8l:s«K«KHt1t 

S;$rttfl)» *58tt«JB^4J^T<i, mi8{z&V&z*- 
— jffy*7x-^»€rK9»&, *fcOWW»5Ha 
S2 81 3, ^-^-h2 814ay : V^^^i:2 81 

[ 0 1 1 4 1 -fe 2 8 0 1 2U^tt<0^i2US«2 8 1 2 

7lJ- bt:ir>T3>f> bfll«t:5ilDSiiT t Jl^. 
ffl]tm*V7V-htfimWt&il2& 0 2^7*y7o 
-riSh*^ ^^^281 3iz^r^ixh^xR 

v/\xii*-x- vsiwtmo*- jL-^mmzx -> 

Sn^ffl«tiiS^«m^li 2 8 0 2 fc 1SSOX7 x ^ h 
40 a4 7 K 7^;W^^^y^2M/7-f7-f¥ 281 OfcO 

iBKbe u ^ 2 8 o 3 5^ Cx &n®m% 2809a 
t/aj^-h2 8i iNifefi, mzhz. ?>t> 
httmmmm v9 2 8 0 5 &a LT3 y v*-9 2 

if£T)7t:^^T^S2 8 1 3±*ca^S*iS. 3>r> 

3&«l)>^2 80 5*^LT3ytra-:^28 04^eaj 
50 SttS. 
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[0115] a-1«ifc&«*28 0-6 at/28 1 4 1 

m«*>&mt. wtsmy^isorattx. 2s 1 
x ^ bat/? * w« i 3 can- 

SiifcBJ-ft*BS 2 S 0 9atf8BBte>x7 x ? b^x * 
K 7<;l*A>7at/T7^f f 2.810'v:iybo 

-Ais^t-L-ceasn*. 2Jafayy?-2 80 7u« 

2 810, SfiA4lfl(H2 809 Rim±mW:2 8125 

*to*ac«aBA*±«W!«9at/. «ri? 

£SS2 8 1 20£«mT-5'.*at//XliS43 V: 

[0116] JL-T (IT »J 7 T i^X&t/T? *;U ba 

>x£ 3 /f^^ >Xf^ 2 8 04 £SLT£3!1-£ C 

com hWSWWz 4 r 7 =r )V b RStcfiBfc $ ft 4 . 

r'y 7 r t > XR5SiHEK:#Js$ * ^yXfi^!: 

4< ry7rpyxat<T7*;l<b«£[ia»:jyt:A 
-*yXTA2 8 0 4^-»T*65«HWt^*y CIS 

[0 1 1 7]"a>K£ ^Xryr^-b&fflfclT, 
T y 7*o- FifflKr-f >-7V - b<OWt£lTC38«-r 

o— ^y b\ -\ h * M < y b # ai/ ? 7 *sv 9 *- 
yx b K**>f /l/£*t*9sKA'y K0>& * * 

<>r . > <y h s v ;^f^7v- b cos 

S (az/Hfr) icfcwc. x-iftfAy F^£X;M 
;K 3 Cf**%» 'b*-/k 1»K x^ 

(iJEK^Of-v*^ {Xi£#ffrf4-fcy-9-> aWKSOlt 

#-*/Uffl"C**O3SN0»Sfefli**i*. *LT. aV 
b' $ *y ^XrvrU-b«i*f-ir*7PTflM^t&ir^ 

b£±£t4. 

[0 118] Tlirxb^v (b'7^7 

y> *S«?tsctm'^. rxb^yfcfcivc. a* 
y ks nr^^yrv«b«3>f'ybflH8*iKfffC 

>r co-b >ytmi\tzmm<zm&<nmz %^x v ^ ^ 

7KAV*at/»»*iE 7>f^D7*^S 

tX7x; bat/ 7 */U$'fcJ;4ffi*«0«SWMriili(a* 
I*A4<r£: tr£4. HSfc. A>K#b'7^7V£IE 
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[0 119] =fe>lf2 801-C1Dafc5*ifcT-> (ffi 
ft) fcov^. «S!«Ba«a2-8 0 2[iri>7 l > bffiffi 



?>ttjlU£m\ i<03y7-ybflr«8r3y^jL-^2 8 

*feayir.jL-^2.8 04fr*#f-^>*/^*>^fcW 
T4. 7*;b* kfj?n94 *74*-S,bV) *> 

io 4. 3veA-*2804ii±fc. r>rb-b<o»« 
x**r>Wca*-f4J:3K:- x7x7b5:ISSL^o^ 

. [0120] Witf . a-iflidf-*^^^ *AfcKT 
U-b«raR"f4Cfc3»«T'&4* b^7 , xy] 

ti4W9BKlWt«fflSfi4. 

20 I Oil 2 1 ] IfrlKtfb. tLa-f*«?J^y?« 

a^ru-bSrSRLfca^iii, £T*>f-**;m 

*^^R5g3fi^C& 4H0 3 F±Bfc=fr« i ^ (caW tx 
Sftk. *H^)K*(CT6 4«tiSv^f*W 

Ayj^SratfcHD^ X7i^hSf^*^ 

[oh 22]MLfcJ:ii:, xyrv-biiStff^ 
«s|«^a«ffi«t3*rbv^xfejL--ir<2ft«T 

4. j**M0WKcfcvvc. a»»»tttJ»5^^y^ 

1/ $ j* y ^OHtcff 3tft«7W^ e&tt < t 
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Boolean Set IpFor Por tr ai t (Boolean Ul.Flagsl 

Boolean. Result = TRUE ! 

// Assume only called IF 0 < niraFacesDetected < 4 

IF IndequateMarginAroundGeoroetricCentr^(iniage) THEN 

ULFla^(200M_0UT) = TRUE . j 

Result = FALSE 
ELSE IF ToHuchMarginAroundGeonetric Centre (image) THEN 

UI_Flags[Z00MJN) = TRUE 

Result = FALSE 
EN'OIF 

IF ((FacesBoundingBoxTallerThanltlslvidf (image) AND 

CameraOrientation Equals LANDSCAPE) 
(FacesBoundingBoxKidererThanltlsTal i (inage) AND 
CaneraOrientation Equals PORTRAIT*) Then 

U LF 1 ags f CHAN6E.0R IEXTAT I ON) = TRUi 

Result - FALSE . 
END1F - 
IF (FacesBoundingBoxCentred (image) EQUALS FALSE THEN 

U I .FLAGS (CENT RE.BOUND 1 NGBOX] = TRUE 

Result = FALSE . 
END1F 

RETURN Result 

) 

Void roain() 

Boolean l ! I F 1 ags (CONST_\UH-UI .FLAGS) 
IxnageType image 
TemplateType tempi ateSelected 
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. U H 1 1 . K PowereilOn j 
IF MenuButtonPressodO Then j 

teoplateSelected » DisplayAvailableteinplatcsO 
END1F j 

Get I aagel nVi cwf lnder ( i mage) 
// T>TU-hA*A««£0)*x <*9 
IF templateSelected EQUALS CONST JHJRTRAt TEMPLATE THEN 

IF SetlpForPbrtrait(UIFIags t image) EQUALS TRUE THEN 
. UIFlags(PlCriJRE.Al.IGN'FD) = TRUE 

ENDIF 
ELSE1F 

Other checks for other templates 

ENDIF 

UpdateUKUIFIags) 
END WHILE 
> 
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1 Title of Invention 
MULTI-MEDIA EDITING METHOD AND APPARATUS 



2 Claims 

1. A computer implemented method for 
sensory perception by a user, said production 
element and a visual element able to be 
including the steps of: 

(a) extracting from at least one portion 
content infonnation relating to a perceivable 

(b) creating said production by 
predetermined (first) set of production rules 
extracted content information. 



cheating a dynamic production for 
luding at least one of an audio 
perceived by the user, said method 



of at least one said eleraenl 
conflent of said portion; and 

applying at least one of a 
.t{> aid portion according to the 



2. 
of: 



A method according to claim 1 including the further steps, before step (a), 



one 



portion at least one of a 
form said content information 



(aa) applying to said at least 
predetermined (second) set of production rules 
corresponding thereto; and 

(ab) associating said content information with the corresponding said 

portion. 

3. A method according to claim 1 whereijn. step (b) includes editing said 
portion to provide a correspondingly altered porion based upon said first set of 
production rules as selectively apptfed to said extracted content information. 

4. , A method according to claim 3 whereia said step (b) further includes 
examining said extracted content information and) said first set of production rules 
to selectively apply at least one of said first prcc 
form said altered portion. 



duction rules to said portion to 



5. A method according to claim 2 wherein each said element has 
corresponding rules within each of said first and] second sets of production rules 
and step (aa) includes applying the corresponding production rules to the 
corresponding said element within said portion. 
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6. A method according io claim 1 wherein $aid elements include at least one 
of audio elements, motion visual elements, and still visual elements and said 
portions include at least one of a characteristic qf said element and a division of 
said element. 



7. A method according to claim 6 wherein 
and said portion is at least one of a loudness, a 
applied to, said audio element 



said element is an audio element 
pijtch, a tempo or beat, and a delay 



8. A method according to claim 6 wherein 
and said portion is at least one of a brightness, 
segment of a frame, of said visual clement 



9. A computerised method of forming a cynamic media production firom 
source media having elements including at least one of audio media and visual 
media, said method including the steps of: 

(a) receiving said source media; 

(b) analysing at least one said element for at least a portion of said 
source media with a predetermined set of cor tent rules to extract thereirom 
content information associated with a corresponding portion of said source media; 

(c) examining the content information of at least one said portion to 
determine a limited set of production rules applicable to the corresponding said 
element; 

(d) selectively applying at least one of said production rules to a 
corresponding one of said elements so as to alter 
and 

(e) combining at least said altered element with other of said media 
to form said media production. 



said* element is a visual clement 
a colour, a motion, a frame, a 



said corresponding one element; 



10. A method according to claim 9 wheifein 
substantially automatically performed and step 
selection of said one rule and the corresponding 
selected rule is to be applied. 



steps (bX (c) and (e) are 
(d) includes a user making a 
said one element to which the 
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11. A raclhod according to claim 10 wherein 
representation of said at least one element and the 
of rules to the user in anticipation of the selection bf step (d), 



12. A method according to claim 9 wherein said source media includes audio 
and visual elements and said rules include a duration of each of said elements and 
said method includes the step of modifying a duration of at least one of said audio 
and visual elements to match a desired duration! of the other of said audio and 
visual elements, 

13. A method according to claim 9 wherein said source media includes an 
audio element and said associated content infoijniation includes a beat of said 
audio element and said method includes altering i duration of said audio element 
according tb'said beat. 
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step (c) includes presenting a 
corresponding said limited set 



14. A. method according to claim 13 whejrein said altered duration is a 
multiple of a beat period of said audio element j 

** i 

15. A method according to claim 12 where jn said source media includes a 
visual element desired for reproduction coincident with said audio altered audio 
element and said method includes trnnming a deration of the visual element in 
relation to that of said altered audio element 



16. A method according to claim 15 wherein said visual clement is trimmed 
to coincide with the duration of said altered audio element 

17. A method according to claim 1 6 whereini said visual element comprises a 



series of frames and said trimming comprises 
frames. 



omitting selected ones of said 



1 8. A method according to claim 17 whereii 
individual scenes to be reproduced and said 
duration of at least one of said scenes so thai 
coincide with a multiple of said beat period. 



said series of frames comprise 
trimming comprises altering a 
trandiiens 'between said scenes 
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19. A method according to. claim 16 comprising the step of examining said 
series of frames according to a set of omission rules to determine those ones of 
said frames most appropriate for omission, and i 
determined frames. 



then omitting selected ones of the 



20. A method according to claim 19 wherein 
established so as to identify those ones of said 
impact upon a visual quality of said media production, 



said set of omission rule are 
frames that, if omitted, would least 



21 



said omission rules include: 
by motion relative to others 



A method according to claim 20 wherei n 

(i) detection those frames least affected 
of said frames; 

(ii) detecting those frames proxinjal to a pan or zoom for omitting 
other ones of said frames; and 

(iii) detecting those frames of diminished focus compared to other of 
said frames and omitting. the diminished focus frames 



22. A method according to claim 17 further 
period for reproduction of said audio element t 
visual clement 
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comprising altering the beat 
3 adapt the audio element to said 



23 . A method according to claim 1 7 wherd : 
is modified according to a transition between 
transitions including a butt edit, a wipe and a fade. 



24. A method according to claim 12 further comprising modifying an audio 
output level associated with said audio element. 



24, A method according to claim 9 whereih 
audio element is used to select an alternate 
characteristics for substitution in said media promotion, 



said content information of said 
e audio element having desired 



25. A method according to claim 24 wherein 
form the group consisting of average volu[ne ; 
frequencies. 



n a duration of said audio element 
scenes of visual elements, said 



said characteristics are selected 
beat period,' and dominant 
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26. A. method according to claim 9 wherein said content information of said 
visual element includes metadata encoded with sjaid visual element with a creation 
of said visual element 



HHTM-234560 



27. A method according to claim 26 
include zoom data regarding a visual image 



wherein said content information 
in said visual element 



present 



28. A method according to claim 9 further 
image representative of said visual element 
visual element includes in said content i 
identifier to said user as an significant portion of said 



^ompiising the step of printmg an 
upon characteristics of said 
informatii )n, said printed image forming an 
visual element. 



29. A method according to claim 9 wheriin 
content information related to colour and/or huiuiaui 



30. A method according to claim 29 further 
user generated visual element from an image 
colour content information thereof. 



31. A method according to claim 30 wherein 
element includes at least one of textual elements 



32. A method according to claim 9 wheifein said content information is 
generated with a creation of said source media 

33. A method according to claim 9 vfherein step (b) is performed 
substantially simultaneously with step (a). 

34. A^nethod according to claim 29 whereir} said content information is used 
to determine one of a wipe or a dissolve between adjacent portions of said visual 
element 

35. Apparatus configured to perform the method of any one of claims 1 to 
34. 



said visual element includes 
ice of said visual element. 



comprising the step of creating a 
visual element dependent upon the 



said user generated visual 
ind graphic object elements. 
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36. A computer program producl including 
incorporating a series of computer implemented 
the method of any one of claims 1 to 34. 



a computer readable medium' 
e steps arranged for performing 



37. 



source media including at least 



A media production system comprising: 
a media input arrangement for receiving! < 
one of audio media and visual media 

analysing means for analysing said source media to extract therefrom 
content information associated with a corresponding element of said source 
media; 

examining means for examining, the corjtent ^formation of at least one 
said element to determine a limited set of proiuction rules applicable to the 
corresponding said element, 

command means for presenting to a user of said system at least said set 
of production rules and corresponding representation of said element and for 
receiving user input commands of selected ones of said rules to be applied to 
corresponding said elements; 

modifying means for applying $aid selected rules to a corresponding one 
of said elements so as to alter said corresponding one element; and 

combining means for combining at least i 
of said media to form said media production. 



38. A system according to claim 37 wherein 
audio and visual elements and said rules include 
elements for which a duration of at least one of 
modifiable to match a desired duration of the 
elements. 



said source media includes 
a duration of each of said 
said audio and visual elements 
ither of said audio and visual 



39. A system according to claim 37 whereir 
audio element and said associated content infor nation 
audio element and said modifying means acts to 
e! anient according to said beat 



said altered clement with other 



said source media includes an 
includes a beat of said 
alter a duration of said audio 



40. A system according to claim 39 wheiein said altered duration is a 
multiple of a beat period of said audio element 
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41. A system according to claim 39 wherein 
visual element desired far reproduction coincident 
clement and modifying means acts to trim a 
relation to that of said altered audio element 



diialii 



42. A system according to claim 41 wherein 
to coincide with the duration of said altered audio element 



43. A system according to claim 42 wherein 
scries of frames and said trmiming comprises 
frames. 



44, A system according to claim 43 wherein 
individual scenes to be reproduced and said 
duration of at least one of said scenes so that 
coincide with a multiple of said beat period 
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said source media includes a 
with said audio altered audio 
ion of the visual element in 



said visual clement is trimmed 



said visual element comprises a 
omitting selected ones of said 



said series of frames comprise 
trimming comprises altering a 
transitions between said scenes 



45. A system according to claim 43 wherein 
said series of frames according to a set of omissi 
of said frames most appropriate for omission, 
operable to omit ones of the determined frames as 



said examining means examines 
an rules to determine those ones 
and said modifying means is 
selected by said user. 



46. A system according to claim 45 
established so as to identify those ones of said 
impact upon a visual quality of said media produdti 



wherein said set of omission rule are 
frames (hat, if omitted, would least 
ion. 



47. 



affected 



A system according to claim 45 wherein ! 
(i) detection those frames least s 
of said frames; 

(ix) detecting those frames proximal lo a pan or zoom for omitting 
other ones of said frames; and 

(iii) detecting those frames of dimiriished focus compared to other of 
said frames and omitting the diminished focus frs mes. 



said omission rules include: 
by motion relative to others 
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48. A system according to claim 40 further y/herein said modifying means is 
operable to alter the beat period for reproduction of said audio element to adapt 
the audio element to said visual element 



49. A system according to claim 39 wlwfcrel 
operable to alter a duration of said audio element 
between scenes of visual elements, said transhiclns 
and a fade. 



50. A system according to claim 39 
operable to alter an audio output level associated 



51. A system according to claim 37 wherein i 
audio element is used to. select at least one alternative audio element haying 
cesired characteristics for substitution in said medaa production. 



in said modifying means Is ' 
according to a transition 
including a butt edit, a wipe 



whurein said modifying means is 
' vith said audio element. 



said content information of said 



54. A system according to claim 51 wherein 
form the group consisting of average volume 
frequencies. 



said characteristics are selected 
beat period, and dominant 



55. A system according to claim 37 wherein 
visual element includes metadata encoded with said 
of said visual element. 



said content information of said 
visual element with a creation 



56. A system according to claim 55 wherein 
zoom data regarding a visual image present in saic , 



&id content information include 
visual element 



57. A system according to claim 37 further 
image representative of said visual element basbd 
visual element includes in said content information, 
identifier to said user as an significant portion of sfcid 



58. A system according to claim 37 wherein 
content information related to colour of said visua] 



omprising means for printing an 
upon characteristics of said 
, said printed image forming an 
visual element. 



said visual dement includes 
element 
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59. A : system according to claim 58 further] comprising means for creating a 
user generated visual element from an image vijsual element dependent upon the 
colour content information thereof, 



60. , A computer readable medium incorporating 
implementable steps arranged for forming a 
source media having elements including at learit 
media; said computer program product including 

a first module for receiving said source 

a second module for analysing at least; 
portion of said source media with a picdetcnnii ed 
therefrom content information associated with 
portion of source media; 

a third module for examining the content 
portion to determine a limited set of production 
corresponding said element; 

a fourth module for selectively applyii 
rules to a corresponding one of said elements so 
element; and 

a fifth module for combining at least 
said media to form said media production. 



a series of computer 
dynamic media production from 
one of audio media and visual 

media; 

one said element for at least a 
set of content rules to extract 
corresponding element of said 

information of at least one said 
rules applicable to the 



3 Detailed Description Of Invention 
Field of the Invention 

The -present invention generally relatk multi-media editing and, in 
particular, a method of creating multi-media 
information of elements of the production to guide in a construction of the multi- 
media production- 
Background Art 

Combining still images, text, videos, 
elements into a production is a complex task that i 
many diverse areas. Video editing is a well esfe Wished field in which numerous 
types of elements are combined to form a final production. The types of 
elements often used in the ajnstraction of a vid< o production~are visual, audible 
and textual. Visual elements include such things as video footage, still shots and 
animation- Audible elements include such tlings as backing tracks, sound 



as 



at least one of said production 
to alter said corresponding one 



said altered element with other of 



sound and other multimedia 
requires extensive knowledge in 
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effects, commentaries and recorded audio of die video clips.' Textual elements 
include such things as titles, credits and subtitles J 

These elements have various pioperties| that can be altered and effects 
that can be applied. The dements can then be -combined in many different ways 
to form' a final product and for each corabiria'ion there is a large amount of 
knowledge that is relevant to the choices that must be made. 

For many years, this extent of production was available only to TV 
stations and large production houses. With the advent of home video cameras, 
personaLcomputers, inexpensive video capture ca nds and video editing software, it 
is now possible for many mcropeople to create thfeir own video productions. 

However, the knowledge needed to mala! good choices must be learnt by ■ 
the person creating the production. For many people who only wish to put 
together a few simple productions the learning! curve is quite steep and poor 
quality productions are created due to a lack of informed decisions. Similar 
difficulties arises in the case where it is desired to create a production made up of 
digitised stills and music, stills and text, video n^terial alone, or sound material . 
alone. 

Thus there exists a need for an apparatus, system and/or method for a 
guided creation of a production which provides assistance and guidance to a user 
creating such a production. ! 
Summary of the Invention j 

In accordance with one general aspect <jf the present invention there is 
provided a computer implemented method for creating a dynamic production for 
sensory perception by a user, said production including at least one of an audio 
element and a visual element able to be perceived by the user, said method 
including the steps of: 

(a) extracting from at least one portion of at least one said element 
content information relating to a perceivable content of said portion; and 

(b) creating . said production by 
predetermined (first) set of production rules to 
extracted content information. 

Preferably, the method indudes the further steps, before step (a), of; 

(aa) applying to said at least on r portion -at* least one of a 
predetermined (second) set of production rules tef form said content information 
corresponding thereto; and j 



applying at least one of a 
said portion according to the 



I 

! 

! 
i 

j 
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i aspe* 



I element 



con«nt 



(ab) associating said content 

portion. 

In accordance with another general 
is provided a compuxcrised method of forming a 
source media having elements including at least 
media, said method including the steps of: 

(a) receiving said source media; 

(b) analysing at least one said 
source media with a pre<kterrnined set of 
content information associated with a corresponding 

(c) examining the content informal! m 
determine a limited set of production rules applicable 
element; 

(d) selectively applying at least 
corresponding one of said elements so as to alter 
and 

(e) combining at least said altered 
to form said media production* 



informajdon with the corresponding said 



of the present invention there 
lynamic media production from 
one of audio media and visual * 



on 5 



of said production rules to a 
said corresponding one element; 



e ement with other of said media 



Other aspects of the invention including 
program products will become apparent from an 
description and of the claims appended hereto. 
Detailed Description 

Fig. 1 shows a block diagram of an ovetv 
a Multimedia Editing device 100. The Multimedia 
processing urrit 101, a storage unit 102, a 
communications port and corresponding bus 104 
application software code used by the processor 
the user interface unit 103. The storage unit 
rules used in the creation of a production and one 
used in the production. The term production is 
because a production could be a video production 
of still photographs presented as a slide show 
Elements, as described previously, include visual 
textual elements which can be described, quite 
production. The visual elements may include 



Apparatus, sytenis and computer 
understanding of the following 



unfit 
102 



for at least a portion of said 
rules to extract therefrom 
portion of said source media; 
of at least one said portion to 
to the corresponding said 



icw a preferred embodiment of 
Editing device 100 includes a 
iser interface unit 103, and 
The storage unit 102 stores 
1 01 to control and respond to 
is also used to store various 
or more elements that are to be 
ised here in the generic sense, 
a musical production, a series 
ox a combination of these, 
elements, audio elements and/or 
generally, as components of a 
footage, video clips, that is, 



video 
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a portion of a video footage; a single video frams, an entire movie, computer clip- 
art, photographs, and created images such as those used in video animation. The 
audible elements may include sound recordings, sound effects, music and musical 
scores, single and multiple tones or notes. Textual elements can include titles 
and credits of a production, advertising such ts logos or slogans, and/or olher 
indicia, 

In the overview of the preferred embodi merit the communication port and 
corresponding bus 104 is used to transfer data to and from the storage unit 102. 
The data is typically a digital representation of the elements previously described. - 
The communication port and corresponding bus 104 is use for other purposes as • 
well, for instance downloading or uploading m« application software code. An 
example of a bus 104, and corresponding interface, is that defined by the IEEE 
1394 high-speed serial bus standard 

. The processing unit 101, aided by the application software, performs and 
analysis of the elements to extract content information. The extracted context 
information is stored in the storage unit 102 and is associated with the 
corresponding element from which the content information was extracted. The 
content information is specific to the various c ifferent- types of elements, (eg., 
visual, audio, textual) and as such the analysis lerforraed by the processing unit 
101, in conjunction with the software, will vlary accordingly. The analysis 
performed on the various elements to extract, or in some cases generated, the 
content information will be described hereinafter under a corresponding 
subsection. 

The analysis for extracting the content information can be done as an 
_ofF-line_ process, that is, al some time after i:he various elements have been 
downloaded to the storage unit 1 02. However, i t is envisaged that at least some, 
if not all, of the analysis could be done _on the; fly_ as the data of the various 
elements is downloaded 104 to the storage unit 102. In the preferred 
implementation, the analysis of the various elemc nts may be performed at least in 
part by a recording or capture device \vhich is i sed to obtain the element For 
example, a digital video camera (DVC) can be modified to store or record not 
cmly image data and sound data, but also metadata such as date, time, number of 
video frames take etc. . An example of a DVC for capturing selected elements 
which can be used by the preferred embodiment is described below as an 
"Enhanced Gathering Apparatus". 
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an i 



effects, 
I wilt 



Referring to Fig. 2, there is shown a 
script 1300 comprising a plurality of visual and 
production. The input script 1300 of Fig. 2 is 
is a video presentation, however input scripts for 
as audio-productions, still frame _sli.dc show 
as printed natter, (ie. a book, catalogue etc.), 
elements of the script 1300 include video 
preferably stored in digital form, and a digital 
video segment having substantially one image 
to provide the appearance, when rendered to a 
frame image paused for a predetermined 
comprise audio backing tracks 1301 and 1306 
tracks include musical tracks and/or sound 
tracks in addition to an audio track associated 
this description a reference to a video segment, 
a reference to a video segment including an 
audio track is available. For example, video 
recording associated with the video footage, like 
noise. This audio information is assumed to be 
purpose of the description of the preferred 
appreciated that embodiments may be practiced 
source information. 

Input scripts may be rendered (reprod 
parallel, as the situation dictates or as need 
-preferably rendered sequentially. However, 
implementations, audio elements are typically 
channels to the visual elements. In the 
first audio backing track 1301 is commenced 
concurrently with a sequential output of visual 
display device. At the end of the visual element 
audio backing track 1301 to the next sequential 
further sequential visual element 1305 is 
backing track 1306. A sjuchronicity between 
element and an audio backing track is desired, 
information is encoded with each element, whethejr 
textual. Extraction of content information may 



segments 

jrtill 



blqck diagram representing an input 
audio elements for generating a 
example of a production which 
other forms of productions such 
r presentation, productions such 
are also possible. The visual 
1302, 1304 and 1305, 
image 1303 which can be a 
reproduced a number of times so as 
\ of a still image or a single 
(Juration. The audio elements 
Typically the audio backing 
and in some cases are audio 
a video segment Throughout 
uhless specified to the contrary, is 
associated audio track, where the 
focjtage usually comes with a sound 
a persons voice or background 
part of a video segment for the 
embodiment, although it will be 
i sing only one of visual or audio 



anse. 



arrangement 



arid 



displayed 



uced) either sequentially or in 
The input script 1300 is 
as in most multimedia 
Hindered in parallel via different 
of the input script 1300, a 
outputted to an audio device 
elements 1302, 1303 and 1304 to a 
1304, a transition occurs from 
l udio backing track 1306, and a 
concurrently with the audio 
commencement of the visual 
preferably associated timing 
the element is visual, audio or 
performed 'live", for example 
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whflst recording the visual image and/or th$ sound source. This may be 
achieved substantially automatically or semt-autoraatically. with user input In 
some instances, content information may be gererated after recording takes place 
under manual control or through automated post-processing. Preferably each 
element further includes: 

* information that directs a proc< ssing application to a source data 
and content da!a assocj ated witfi the element; and 

* supplementary information sue h as duration of an element.' and 
an oflset start time relative to si >urce data. 

Referring to Fig. 3, there is shown a flow chart of a beat synchronisation 
process 1420 in accordance with the preferred embodiment The beat 
synchronisation process 1420 receive input in the form of a plurality of elements 
(ie. an input array of elements) in a pre-determinfd sequence or order. An output 
of the beat synchronisation process 1420 is an! input script substantially of the 
form of the input script 1 300 of Fig. 2. However each element of the input array 
of elements may or may not be altered by the beajt synchronisation process 1420. 

Initially at step 1400 the beat synchronisation process 1420 receives as 



input an array of elements (visual, audio etc.) 



of a production, preferably in a 



predetermined order. Next an empty output amy is created at step 1401 having 
a substantially similar number of available entiyl slots as the number of elements 
of the input array. In this creation step 1401, a pointer is also initialised to a 
starting point of a first clement of the input arr^y. Control is then passed to a 
next step, a decision step 1414, which decides if there are elements in the input 
array to be processed. If the result, of the decision step 1414 is _false_, then a 
current output array is outputted 3409 in a format represented by the input script 
1300. Otherwise, if there exists at least one dement, the decision step 1414 
returns _truc_ and proceeds to a copy step 1402 where a current element of the 
input array (source array) is copied to a slot of the output array. The copy step 
1402 is followed by a next step in the flowchart 1420, an _audio element^ 
decision step 1403, which returns a true value iff the current element is an audio 
backing track, otherwise the step 1403 returns a jfelse. At a true result from the 
audio element decision step 1403 the process entfers a read input step 1406which 
reads from a supplementary information portion of the current element the beat 
period, and sets a current beat period accord ugly. This step may include 
calculating the beat period. The pointer is advanced at step 1413 to a next 
element of the input array. At an otherwise fals result from the audio element 
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decision step 1403, an additional decision step|l404 is entered which determines 
whether or not a current beat frequency has ijeen set The additional decision 
step 1404 return a true value when a current tjeat period has been set, and false 
otherwise, A false decision at step 1404 results in the pointer advancing at step 
1413 to point to the next clement of the inpjit array. A true result from the 
additional decision step 1404 has the process 1420 enter yet a further decision 
step 1405 which determines whether or not the current element b affected by the 
current beat period. In the event that the current element is not affected by the 
current beat period, the pointer is advanced at $tep 1413 to the next element A 
true result from the decision step. 1405 for determining whether or not the current 
element is affected by thereat period, leads to a further a decision step 1410 for 
deciding whether or not the current element is a jstill shot_ sequence. At this 
decision step 1 41 0, if the current element is a slill shot then a trimming step 1 408 
is .performed on the current element the current element being the current element 
of the output array, that is, the element copied at process step 1402. Following 
the trimming step 1408 the pointer is advanced at step 1413 to the next element 

A false return from decision step 1410 (ie. the current element is not a 
still shot), leads to a decision step 141 1 which determines if the current element, 
not being a backing track or still image, includes predetermined video conditions 
such as a zoom shot sequence, a pan shot sequence or other predetermined video 
special effects. No video conditions being identified (determined) for the current 
element, a trimming step 1408 is performed on the current element On each 
occasion that the trimming step 1408 is performed on an element (visual element). 
The element is trimmed to substantially a multiple of the current beat period. As 
previously described, following the trimming $tep 1408 the pointer is advanced 
1413 to the next element (ie. a next input element to be copied to the output array, 
if any). If a video condition is identified, at step 14 1 1 , a true is returned from the 
decision step 141 1 and the current element is trimmed at step 1412 in accordance 
with predetermined rules defined for each vijieo condition Examples of the 
j^etamined rules applied are described jiereinafter. The process flow 
following the trimming step 1412 leads to the pointer advancing step 1413 
previously described. Once the pointer is advanced to the next element of the. 
input array, a decision step 1407 checks whether or not there are further elements 
in the input army. If so, the process is looped back to the copy step 1402 and the 
steps previously described subsequent to the.aipy step 1402 are processed until 
the decision step 1407, checking for further input elements returns a false, in 
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ending the beat synchronisation 



which case the output array isWputted 1409 
process 1420 until it is re-evoked. Although the above describes trimming the 
video, similar processing may be used to either stretch or compress the video so as 
to match the beat frequency. 

Referring now to Fig. 4, there is shdwn a flow chart of a transition 
generating process 1500 in accordance with <he preferred embodiment. The 
transition generating process 1500 determines a type of transition to be used 
between video elements and determines the duration of a transition. The 
transition is not rendered until a fmal production is Tendered to an output display 
device 

i 

Initially, the transition generating proceks 1500 receives as input as input 
array of elements. Each element in the input array includes information of a 
corresponding channel, or channels, to which it will be rendered. At a first step 
1501 in the process 1500, an empty output array is created with substantially the 
same number of slots as the number of elements of the input array. At this step 
1501 initialisation procedures are also performed For example, a source pointer 
is set to point to a first element of the input arrty, a destination pointer is set to 
point to a first available slot of the output array, and a beat period variable is set to 
a default value until a new value for the beat period is determined. Further, for 
each video channel, a variable (ie. TrevEle")! is supported which points to a 
previoi^ video element Initially, since no previous video elements are available, 
the variable PrevEle is assigned a value indicating no previous video elements. 
Following initialisation , control in the process 11500 is transferred to a decision 
step 1 507 which determines whether or not therejare elements in the input array to 
be processed. If no elements are to be processed, the decision step 1 507 returns 
a false and current values of the output array are outputtcd in a form of an input 
script substantially as illustrated by Fig. 2. 

If the input array is an empty array then an empty input script.will result 
(ie. no input, script). However, if there are eljements of the input array to be 
processed, decision step 1507 will return true wjhich leads the process to a copy 
step 1 502, At the copy step 1 502 a current inpit (array) element is copied to an 
available slot of the output array. Subsequent to the copy step 1502 a decision 
step 1503 is entered which determines whether lor not a current element (copied 
element) is an audio backing track. If the cunjent element is an audio backing 
track, the current beat period is set to the extracted value in step 1506 and 
Incremented in step 1518 to a next element ofl the inpuT array. Otherwise, at 
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decision step 1503* the current clement is hotja audio backing track arid a next 
step 1504 is entered which determines whether br not a previous video clement on 
the current elements video channel, for which a transition is required to the 
current video element, exists. Jf no previous /ndeo element exists on the current 
video channel, a set JPicvEe. step 1505 is entered; which sets the J^wvEle/ 
variable to point to the current element and then) passes to the increment step 1 513, 
If a previous video element (ie. to the current |(vide©) clement), is available, the 
process flow enters a decision step 1508 which checks whether or not a fixed 
transition style (eg. a butt edit transition) haii been selected by a user of the 
Multimedia Editing device 100. ^Tiere a fix ;d transition has been selected, a 
marking step 1510 is entered which marks the previous video element for 
transition to the current video element 

If no fixed transition is selected, the decision step 1508 passes to an 
extract colour data step 1513. Preferably lumi lance data is extracted from a tail 
end of a previous video element and a front end! of the current video clement. A 
next step 1514 is entered which decides on the (basis of the extracted colour data 
whether to choose a dissolve transition, selected in step 15 1 5, or to choose a wipe 
transition, selected in step 1516. In the case 4f a wipe transition, an additional 
step 1517 is used to analyse motion vectors oj both a previous and the current 
video clement to determine details of the wipe transitions. Such wipe transition 
details include starting point, speed of wipe etc, | 

Following on from the additional step Ij517 of the chosen wipe transition 
or from step 1515 for choosing a dissolve tran dtion, both return to the marking 
step 1510 previously described. At the markSng step 1510 the previous video 
element is marked for transition to the current video element in accordance with 
the chosen transition (ie. Dissolve, wipe, fixe d etc.). Following the marking 
step 1510, a decision step 1511 is entered vhich determines if the chosen 
transition has a duration length longer than 4 predetermined duration length. 
Optionally, the decision step 1511 checks for fixed transitions either in addition to 
or instead of the predetermined duration length. At decision step 151 1, a _true_ 
value indicates a duration longer than the predetermined duration length, in which 
case step 1512 marks a duration length of the ch >seh transition to be a multiple of 
the current beat period. Otherwise, decision step 1 51 i returns a _falsc_ 
indicating a shorter duration length than the predetermined duration length. 
Such a situation leads the flow chart back the set _PrevEle_ step 1505. 
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Further, once the determining step 1512 has (narked, the duration length of a 



set .PicvEIe^ step 1505. 



terminates when no further input 
case the current elements of the 



chosen transition, the flow is also returned to the \ 

Again, as previously described, the sit _PrevEle_ step 1505 seta the 
_PrevEIe_ variable to point to the current vileo element and returns to the 
increment to the next input element step 1518. This step 151* incrernaits the 
source pointer and continues for a next input elei lent as hereinbefore described. 

The transition generating process 1500 
elements are available for processing, in which 
output array are outputted substantially in the farm of the input script 1300 of Fig. 
2. 

Fig. 5 shows an overview 1100 of the editing process in accordance with 
the preferred embodiment of the present mventicjn. Initially, a production set-up 
step 1101 occurs allowing the user to select desired visual, audio and/or textual 
elements for a production. Next, scripting proa sses 11 02 are applied to the user 
selected elements. These scripting processes 1102 include the beat 
synchronisation process and the transition generating process previously 
described with reference (o Figs. 3 and 4 respectively. Without departing from 
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other scripting process can be 



the spirit and scope of the present invention, 
applied For example, an editing process tta: edits by manipulating picture 
elements of a frame of a video dip or still image. The output of a scripting 
process is preferably an input script substantially as described with reference to 
Fig. 2. 

Input scripts, resulting from the scriptinjg processes 1 302, are processed 
at a next step 1303 where each input script is interpreted by a script interpreter. 
A decision step 1 104 is entered which decides fori each input script whether or not 
an output from an input script is to be rendered to an output device. If the 
answer to the decision step 1104 is _no_, th<{ flow process, described with 
reference to Fig. 5, is looped back to the production setup step 1 101 for additional 
desired selections by the user. However, if the answer is _y es_ at step 1 1 04, that 
is an output is to be rendered to an output device then each input script, 
comprising elements of a production, is ther rendered at step 1105 to a 
corresponding output device. For example, for $n input script comprising audio 
elements and video elements, the audio elements are rendered to an audio output 
device and a video portion of the video elemerts to a display device, while a 
sound track associated with the video element is *lso rendered to the audio output 
device. Although Fig. 5 refers to a single interpreter, typically one interpreter 
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will be provided for each type of source data find for the corresponding output 
device (eg. audio, visual). 

A final decision step 1 106 checks if thd production is finished, or loops 
back to the production setup step II 06 if h is to c ontinue allowing user selections, 
the loop back allows for a preview of the px>duction by the user. ~ftt" the" 
production setup step 1106, the user is also peimitted to select which scripting 
process is, or is not, to be applied. For example , (he user may desire that no beat 
synchronisation be performed and so this optica is switched off. Further, the 
user can als o select desired output devices. 

Turning to Fig. 6, there is show the . .apply scripting processes step_ 
1102 of Fig. 5 in more detail. At a first step 1201 a copy of user selected 
elements is made, to avoid altering of original lelements, and a list of scripting 
processes to be applied is created. Next, a decision step 1202 determines 
whether or not all scripting processes on the list have been applied. That is, the 
decision step 1202 determines whether the list oif scripting processes contains any 
scripting processes not yet applied. If the ansjver is _no_ that is, all scripting 
processes have been applied; then the input scripts generated by the scripting 
processes arc sent to the script interpreter as described with reference to Fig. 5. 
However, if not all of the scripting processes (on the created list) have been 
applied, at decision step 1202, then the copied elements are passed to a 
corresponding scripting process 1203. For exsimpie, if a beat synchronisation 
process is to be applied to a current copied elemc its then the elements are directed 
to the beat synchronisation process. A next slejp 1204 is to mark off the list an 
applied scripting process and loop back to the decision step 1202 to assess 
whether another scripting process is to be applied. When no more scripting 
processes are to be applied a final generated input script is sent to the script 
interpreter for processing 1 1 03 (see Fig. 5). 

A predetermined set of rules may now b{3 defined to guide the creation of 
a production from a collection of elements, however this set of rules should not to 
be seen as limiting and is only offered by way of example. The examples of the 
rules that can be used in conjunction with the preferred embodiment, are 
described below, however the type of rule deper ds on the final production effect 
to be achieve. It will therefore be appreciated by those skilled in the art that a 
cifferent combination and/or variety of rules c£n be applied without departing 
from the spirit or scope for the present invention. For example, a rule can be 
created that designates that titles or text information to be rendered, to a video 
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screen, as overlay on a video clip, can be overlaid on a portion of the video screen 
where il is determined that the average motion, over the entire video clip, is least 
The type of rule also depends on the type of content information to be extracted 
from the different and various elements. The proceeding sections describe 
different content information extracted for the various elements and associated 
rules which are used to create, or assist in the creation o£ a production. 
Beat Synchronisation 

Referring to Fig. 7, there is shown an example of automatic heart 
synchronisation between an audio tract 200, having a beat 210 represented thereon, 
and a video clip (or video footage) 214. Typically, ±e audio track 200 for which 
a beat is sought and used to synchronise with a video clip 214 is a musical piece. 
The beat is preferably a musical beat of the musical piece represented by the audio 
track 200, however any substantially regular frequency extracted from the audio 
track 200 may suffice as the beat for the purpose of synchronisation. 

. An example of a technique for extracting the beat to allow 
synchronisation of video clips will now be described. An input audio signal 
representing the audio element of a production and in particular a section of the 
audio signal for which a beat is desired, is analysed through a bandpass filter to 
restrict frequencies of the audio signal to a predetermined range. The restricted 
frequency signal is passed through a lead edge detecting circuit that detects. a lead 
edge of the restricted frequency signaL Time intervals between each detected 
lead edge, for the duration of audio signal, for which a beat is sought, are recorded 
and then an average time interval is calculated. This average time interval can 
then be used as the beat to synchronise the musical piece to a desired video clip 

The video clip 214 of Fig. 7 represents an untrimmed video footage 
before it is trimmed to be synchronised with the beat of the audio track 200. In 
this example the untrimmed video footage 214 comprises three sections 201, 202 
and 203 which represent predetermined scenes of the video footage 214. 
Transitions between the scenes, in this example, are formed by butt editing the 
scenes together. That is, three sections, each section typically comprising a 
plurality of frames, have been joined together end on end. 

Transitions between sections 201, 202 and 203 of the untrimmed video 
footage are represented in the illustrated example of Fig. 7, by vertical lines 204 
and 205. The transitions of the untrimmed video footage"204 do not coincide 
with a beat 210 of the audio track 200. The first section 201 of the untrimmed 
video footage 214 is trimmed so that the resulting section 2 1 1 has a transition 203, 
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to a next section 212, coincident with a beat 210 of the audio track. Similarly 
the remaining sections 202 and 203 are trimmed to result in sections 212 and 213 
respectively, so each transition between sections 211/212 and 213 occur in 
synchronism with the beat 210 of the audio track. The trimmed sections 21 1, 
212 and 213 together form a video clip (rootage) where transitions between events 
or changes in scene are synchronised to the beat 210 of the audio track 200. As 
described in Fig. 3 at step 1413, when trimming video footage and video frames, 
are removed from each section trimmed, such frames can be removed from any 
portion of the section. However it is preferred that a content of the section is 
evaluated for predetermined effects end the frames removed are removed so as to 
cause least disruption to the eventual viewing of the production. For example, if 
a section of video footage has a zoom or pan then it may be desirable to remove 
frames which are not intermediate a zoom ox pan. Another example would be to 
assess from a video footage which portion has least motion occurring, that is, the 
portion of video footage which is essentially a still shot, and remove a frame 
substantially from the portion of least morion. AlteraatelVj frames which are out 
of focus in a predetermined section of video footage may be removed. 

Further when synchronising the video footage 214 to the audio track 200, 
it is permissible to process the audio track 200 to increase or decrease an average 
time interval between beats to the extent that the audio track is not substantially 
distorted, so as to fine tune a synchronisation between the audio track 200 and the 
video footage 214. As mentioned previously it may also be appropriate to 
process the video to speed-up or slow-down without editing. 
Transition Speed and Timing Rule 

Generally a video frame rate (frames/second) is substantially constant, 
therefore a predetermined number of frames of a video footage substantially 
defines a specified interval in time. A time interval and hence a transition speed 
between a first section and a second section of a video footage will then depend 
on a number of frames of the video footage used in a transition. A Transition can 
be a simple transition from one scene to another scene of the video footage* 
resulting from a _butt edh_ of two section as described with reference to Fig. 7. 
However, preferably a transition is purposely designed to provide a special effect 
such as a dissolve transition from one scene to a next scene. Other transition 
types include a _wipe_, and a _fade in_ which allow a change of scene with a 
predetermined special effect A liming and speed of such transitions are 
synchronised with a predetermined audio track in accordance with the preferred 
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embodiment aftd in a substantially similar manner as that described above under 
_beat synchronisation^ excepting that video frames can be duplicated and added, 
as well as removed, 1o effect a smooth synchronised transition. A timing and 
transition speed rule is applied to start a selected transition at a first predetermined 

beat marker and ensures, by allowing a predetermined number of frame to effect ~ 

the transition, that an end Dame of (he transition is coincident with a second 
predetermined beat marker. Audio transitions may be achieved by arranging 
respective beats to be coincident during the crossover. 
Audio Level Adjustment 

Referring now to Fig. 8 there is illustrated a representation of audio level 
information 301 of an audio backing track and a sequence of video clips 320-322 
which are to be associated with the audio backing track. A horizontal axis 300 ' 
of Fig. 8 is a time lapsed axis 300 and a vertical axis represents audio levels 
measured in decibels (dB) (note: Fig. 8 is not drawn to scale). A familiar feature 
of video cameras is their capability to record sound as well as video. However, 
when putting together a production it is usually desired to include a further audio 
channel which is an audio backing track. Additional backing tracks that provide 
background audio are common feature in professionally prepared video 
productions, such as a professionally edited wedding video, however such video 
editing is a laborious task which is painstakingly put together by a video editor 
skilled in the art. 

In the preferred embodiment of the present invention, transitions between 
video clips 320 to 322 arc automatically detected and the audio levels are also 
automatically detected. For example an audio level 303 corresponding to video 
clip 320 is detected to be zero decibels (OdB), an audio level 304 corresponding to 
video clip 321 is detected to be absent and so is set to -lOOdb and for video clip 
322 an audio level 305 is detected at -3db. 

. When rendering a production video, a final attenuation waveform 3 1 3 is 
generated with predetermined _ramping^ 310 at each point 311 corresponding to 
a video transition from one clip to the next. The final attenuation waveform 313 
is used preferably to control a level setting for one or more musical scores used as 
backing track to the video footage 307. Further, the attenuation waveform may 
be applied to the backing track so it remains at a fixed,, distance from audio 
associated with the video. In addition, the user sets a desired audio difference 
level between the video camera recorded sound and the audio level of the backing 
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track so that the recorded sound is not obscure by the backing track if this is so 
desired 

Music Matching 

la the preferred embodiment, a first music track is selected and can be 
" used to find and select from a plurality of music tracks, predetermined music — * - 
tracks which are substantially similar to the first music track. These 
predetermined musical tracks can, optionally, be used together with or instead of 
the first music track selected. A technique detenniriing substantially similar 
musical tracks, from a plurality of music tracks, is based on characteristics of 
audio signal of each music track in comparison with characteristic of the first 
music track selected. The characteristics include such features as average 
volume* beat, and dominant frequencies for example, either singularly or in 
combination. An example of how this music matching rule is applied in 
connection with a video production is now described A template for a video 
production is supplied, say by a manufacturer, with a first musk track selected. 
A user can offer a plurality of alternative music tracks which the user prefers over 
the first music track supplied with the template, The music selection rule selects 
based cn one or more predetermined characteristics of the first track, a most 
appropriate music track from the plurality of alternate music tracks. 
Visual Content and Motion - 

In video footage, a plurality of significant visual events may be relied 
upon to identify segments of the video footage foT which predetermined special 
effects are, optionally, applied. For example, morion detection techniques, 
known in the art, are applied to the video footage to guide the type of transition 
that is preferred between a video segment (clip) and a next video segment 

Referring now to Fig. 9, there is shown a video footage 500 incorporating 
a video zoom sequence 501 for which relative zoom ratio 502 arc represented . . 
below each frame 503. the relative zoom ratio 501 is deterrnined using motion 
vectors detected for each frame. Without departing from the scope or spirit of 
the invention, relative zoom ratios 502 can be computed, for example, from 
metadata encoded and associated with a video footage. 

The encoded metadata may be obtained and recorded from a video 
camera, for instance, adapted with zoom sensors and^ circuitry capable of 
providing metadata on a state of a current zoom. 

Turning to Fig. 10, there is shown a _pan sbot_ 600 comprising a video 
pan sequence of a ccttage 601. In substantially the same manner as described 
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with reference .to the zoom sequence 501, the pan shot can be detected from 
motion vectors. Optionally a panning sensor on a video camera can provide 
movement information of the video camera that can be used to determine an 
amount of panning in a _pan-shot_. . 

In the detection of zooms and pan-shots from a video footage, a 
predetermined zoom threshold level and a pan threshold level is optionally set 
which allows the detection of a zooms only where a relative zoom ratio, within a 
predetermined number of frames, is above the zoom threshold level and detected 
pan shots where a relative pan movement, within a predetermined number of 
frames, exceeds the pan threshold level respectively. For example, a zoom 
threshold level set at 3 with a predetermined number of frames set at 2, then a 
relative zoom ratio greater than 1:3 occurring within 2 frames would result in a 
detection of a zoom sequence. 

In each case where a pan shot or a zoom is detected, a user is optionally /. 
given a choice to accept, or reject, for marking the detect pan or zoom accordingly. 
However, the process of marking a video footage so as to indicate locations of a 
pan shot or zoom can alternately be automated so that each zoom or pan detected 
can be marked based on predetermined criteria. 
Printed Summary of Video Footage 

The marking of pan shots and/or zooms is to readily identify those 
segments of video footage to which a special effect is to be applied or those 
segments of the video footage that are to be retrieved for printing, on a print 
device, or to generate icons for the footage. For example, the pan shot 600 of 
Fig. 10 is _stitched together_, that is, composited frame by frame to build up a 
still image pan as illustrated by Fig. 11. This process of stitching together video 
frames is known to those in the relevant art and can be done, for example, by 
determining a translation of predetermined picture elements, in a digitised 
representation, of each frame of the video footage. 

Referring now to Fig. 12, there is shown a compositing of frames 701- 
703 of a video footage to produce a ^salient stilly image 704, Preferably the 
frames 70 1-703 to be composited into a salient still image, for printing on a print 
device, are extracted frames of a zoom portion of a video footage. Illustrated in 
Fig. 12 are three frames 701-703 selected from the zoom sequence shown in Fig. 
9 and which are to be used to create the salient still image 704. To composite 
the salient still image 704, a first image represented by a frame 701 is scaled by a 
first predetermined factor and the scaled image used as a first portion 70S of the 
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salient stUl 704. In Fig. 12, tbc first portion 705 refers to the 8 x 8 components 
as seen. Next, a second image represented by frame 702 is scaled by a second 
predetermined factor and the scaled second image is overlaid, or inserted, upon 
the first portion 705 to provide a second portion 706 of the salient still 704. 
Finally, a third image represented by frame 703 is overlaid (or inserted) upon the 
second portion 706 to provide a third portion 707 of the salient still 704. The 
resultant salient sill image 704 comprise three portions 705-706 of the image 704 
derive from different resolutions, composited together to form a single salient sill 
image 704 which can be printed on a print device. 

It is assumed that in a video footage where _pan shots_ and zoom 
sequences have been detected, the photographer or cameraman taking the video 
footage had a desire to pan or zoom a particular scene and therefore there is a 
likelihood that the _pan shot_ and zoom sequence of the video footage is of 
particular interest Therefore images obtained from these particular scene are 
chosen for printing to a printer device as described with reference to Fig. 11 and 
Fig. 12. , 

Not all video footage includes pan shots and or zoom sequences and 
sometimes a pan or zoom does not contain images of particular interest. In these 
cases, images of the video footage intended for printing on a print device are 
selected based on motion analysis, or other characteristics of die video footage 
such as focus or slow motion blur. For example, determining local minima of 
motion occurring in select key frames is a good estimate that the cameraman has 
stopped (or paused) at an interesting point in a scene, or that characters pause on 
gestures to emphasise their importance, and therefore the selected key frames are 
of interest 

Motion Selected Transition 

Referring to Fig. 13 there is illustrated a display device 900, displaying a 
first video segment 901 and at some time latter displaying a second video segment 
902. The first displayed video segment 901 comprises motion occurring at a 
bottom right hand comer of the display 900. The motion is represented at the 
bottom right hand corner of the display 900 by a first set of motion vectors 903. 
A second set of motion vectors 904 for the second video segment 902 displayed 
on the display device 900 indicates that motion between the first 901 and second 
902 video segments have changed from the bottom right hand comer of the 
display 900 to a left hand portion of the display 900. 
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A transition thus needs to occur if the first 901 and second 902 video 
segments are displayed consecutively. In accordance with the preferred 
embodiment, a transition type is chosen according to a location and an amount of 
motion on video segments to be displayed. Transition types, between a first 

video segment and a second video segment include: wipes which can be vertical. ~ * 

horizontal and or oblique; fades; and alike transitions. 

Turning now to Fig. 14, there is shown an example . of horizontal wipe 
905 transition for the video segments of Fig" 13. The first video segment 901 is 
the outgoing scene while the second video segment 902 is the incoming scene of 
the transition 905;" A horizontal wipe transition from right to left, on the display . 
device, is automatically suggested (or chosen) because of the location of the 
motion in their respective video segments 901,902. The horizontal wipe 
transition 905 from right to left effectively transfers a viewers attention from the 
motion occurring in the first video segment to the motion occurring in the second 
video segment 902 and maintains the viewers attention while the transition occurs, 
slowly, across the display 900. The type of transition is chosen on the basis of a 
location and an amount of (visual) motion occurring between video segments. 
Those skilled in the art will recognised mat a multitude of types of transitions can 
be devised, and corresponding motion rules associated to select a transition type, 
in place of the example described above, without departing from the spirit and 
scope of the present invention. For example, if visual characteristics are such 
that two connective video segments (clips) comprise a majority of a motion, and 
each segment is centrally localised, then a possible transition is that of fading-out 
a first video segment while fading-in a second video segment. 
Colour Content 

Another automated editing process based on a content of an image, in 
accordance with the preferred embodiment, is a selection of colours. For 
example, a selection of colour(s) for an opening title of a video production can, if 
a user so desires, be selected on the bases of statistical colour content information 
about an introductory portion of a video segment or on an entire video footage. 
Colours for titles, for example, can be selected from a complementary set of 
colours or a supplementary set of colours. . The complementary and 
supplementary sets of colours are preferably chosen for a plurality of colour 
available in the video footage. 

Referring now to Fig. 15, there is shown an image 1600 with text 1601 
jnTLE_ overlaid upon the image 1600. The image 1600 may represent a 
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printed image, a still image displayed on a display device or a predetermined 
portion of a video footage rendered and displayed on a display device. 

Also shown in Fig. 15 are two sets of colours* those being a set of 
complementary colours 1602 and a set of supplementary colours 1603, which are 
to be used to provide a colour palette for the text 1601. The complementary 
1602 and/or supplementary 1603 colours are selected based on colour content 
information of the image 1600. There are know techniques for determining 
dominant colours of an image for example, in a simple case an averaging of 
colour over predetermined regions of the image can provide a determination of 
dominant colours. 

Referring to Fig. 16, there is shown a display device 400, with various 
portions 401 to 405 of the display 400 where a colour content of an image may ot 
may not be of interest For example, if graphical elements arc to be used in a 
manner analogous to headers or footers of a document, the portions of an image 
where colour content information would be extracted is indicated by regions 401 
and 402. Similarly, if text information (or graphical elements) Is to be displayed 
at the left portion 403 or the right portion 404 of an image then colour content 
information is preferably extracted from these respective portions 403 and 404. 
Finally, if text information is to be centrally located, a centre portion 405 of the 
image is the portion from which colour content mformation is extracted. Colour 
content information is also used, in accordance with the preferred embodiment of 
the present invention, to guide a selection of a type of transition between video 
segments as previously described. Motion and/or colour content information can 
be used to select the type of transitions between video segments. An example of 
use of colour content information for selecting a transition type is, selecting a 
dissolve transition between a first video segment and a next video segment, where 
an average colour or alternatively luminance content of the first video segment is 
determined to be substantially similar to'an average colour content of the next 
video segment 

The embodiment of the invention can also preferably be practised using a 
conventional general-purpose computer, such as the computer system 1700 shown 
in Fig. 17, wherein the processes described with reference to Fig. 2 to Fig. 6 are 
implemented as software executed oa the computer system J 700. The computer 
system 1700 includes a computer module 1701, input devices 1702, 1703 and a 
display device 1704. The computer module 1701 comprises at least one 
processor unit 1705, a memory unit 1706 which typically formed of 
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semiconductor random access memory (RAM) and read only memory (ROM), 
input/output (1/0) interfaces including a video interface 1707, keyboard and 
mouse (or joystick) interface 1708 . The storage device 1709 can include one or 
more of the following devices: a floppy disk, a hard disk drive^ a CD-ROM drive 
or similar a non-volatile storage device known to those skilled in the art. The 
components H05 to. 1709 of the computer 1701, typically communicate via an 
interconnected bus and in a manner which results in a usual mode of operation of 
the compute system 1700 known to those in the relevant art. Examples of 
computers on which the embodiments can be practised include IBM-PCs and 
compatibles, Sun Sparcstations or alike computer systems evolved therefrom. 
Enhanced Gathering Apparatus 

Referring to Fig. 18, there is illustrated a block diagram overview of an 
Enhanced Gathering device 2100, comprising a content collection unit 2101, a . 
processing unit 2104, a memory storage unit 2103, a user interface unit 2105, a 
read only memory (ROM) 2108* a communications port 2106 and an output 
interface 21 02, which is an example of an information gathering device. 

Optionally, and depending upon a predetermined application of the 
enhanced gathering (capture) device 2100, the communications port can be 
removed and the memory unit 2103 replaced with technology such as PCMCIA, 
bubble memory, a floppy disk or any portable memory device. 

Generated (or gathered) output information can be communicated to 
external devices via the output interface 2102 and represents content gathered. 
The content gathered information can be used as input mformation to external 
devices. For example, external devices can include content recording devices 
such as analogue or digital video records, optical disk drives, sound recording 
devices, image recording devices, printer devices or general purpose computers 
(eg. IBM compatible PC, Apple Compatible PQ Sun Workstation) to name a 
few. The content gathered information includes content data, and preferably 
metadata associated with the content data. An example of content data is image 
data gathered by a video camera device and the associated metadata can include 
such information as the date, time, camera settings and location where the image 
data was taken. 

The Content Collecting Unit (CCU) 2101 preferably comprises a 
plurality of content sensors, each capable of receiving (collecting or gathering) 
predetermined forms of content information. Examples of such sensors include 
a microphone for receiving sound (content) data; a charge coupled device (CCD) 
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for collecting image data; and a light sensor for determining and collecting 
lighting conditions (metadata) associated with collecting image data. Preferably, 
the CCU 2101 further includes elements (transducers) that gather sensory 
information about a current state of various content sensors, or associated 
hardware such as the current zoom factor on a video camera. This additional 
data is typically available for use by the processing unit 104 and can be encoded 
as part of the metadata in the gathered content information- 

At a functionality level, a user selects al least one of a plurality of 
optional templates which are made available to the user through the user interface 
tmit 2105. The user controls the enhanced gathering device 2100 through a 
series of selecting buttons (not illustrated) to make a desired template selection. 
The processing unit 2 1 04, in communication with the memory storage unit 2 1 03 ' 
and/or the ROM 2108, provides, via the user interface unit 2105, the various 
optional templates currently available on the enhanced gathering device 2100. 

Each template typically comprises a series of template instructions which 
can be described by a jredetcrrnined r^gramming language. For example, the 
programming language may be specific to an application and proprietary to the 
device 2100 or can be an implementation of a general purpose programming 
language such as Java (Trade Mark of Sun Microsystems Inc). Template 
instructions are uploaded, via the communications port 2106, from a general- 
purpose computer system 2107 to the enhanced gathering device 2100 and are 
stored in the memory storage unit 2103* 

Alternatively, cartridge systems which are commonly used for computer 
games and/or flashcards for storing the templates can be used as a plug in device 
to upload templates to the enhanced gathering device 2100. Preferably, part of 
the series of template instructions, in particular, instructions which are common to 
several templates can be stored in Read Only Memory 2108 to reduce the amount 
of (RAM) memory required in the storage unit 2103. The template instructions 
are then available to the processing unit 2104 for runtime calculations. 
Preferably, the general purpose computer system 2107 illustrated in Fig. 18 is also 
used as the external device previously described which interfaces with output 
interface 2102 to download the content information. 

A user interface device 2105, for instance, comprising a liquid crystal 
display (LCD) and a series of control buttons, is used to convey (messages) 
information to the user, as well as gathering user input in response to those 
messages. 
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The processing unit 2104 interprets the template instructions to provide 
options including content analysis of the content information, presenting to the 
user various choices for selection of menus available and interpreting a response 
to the menus from the user. The choices selected by the user, influence or 

change: the current state of the CCU2101; user preference settings; and/or the 

current template being used by the device 2100. Preferably, some of these tasks 
are fully automated in that the template makes the best decision from the content 
information available and adjusts the CCU accordingly. For example, in a first 
embodiment of the enhanced gathering apparatus described hereinafter, the 
template may be used to decide from predetermined conditions that a portrait view 
of an image is desired over a landscape viejv and therefore a cropping of the 
image to a portrait view is performed if necessary." 

Fig. 28 is a flow diagram illustrating the general operation of the 
enhancing gathered information. The process commences at step 21100. In 
step 21102, at least one template is uploaded in the enhanced gathering device. 
In step 2 1 1 04, at least one form of content information is received in the enhanced 
gathering device. In step 21 106, template instructions of the uploaded template 
are executed to generate composition instructions based on the received content 
information. In step 21108, a composition of the content information is 
enhanced in accordance with the composition instructions. In step 21110, 
processing terminates. Preferably, the method further involves storing the 
enhanced content information on a storage means and may optionally be 
downloaded to an external device. ^ 
First Enhanced Gathering Apparatus 

The first enhanced gathering apparatus is now described, by way of 
example, with reference to a Digital Still Camera where preferably the enhance 
capture (gathering) device 21 00 is inbuilt or forms part of an enhancement system 
of the camera. In this example the content collecting unit 2101 comprises an 
optical lens system and CCD as is typical for such cameras and can further 
include distance measuring sensors, light intensity determination devices, focus 
detection devices and position locating devices (eg. Global Positioning System 
GPS). These sensors and devices gather image data, and metadata such as a 
location where the photograph was taken, The user interface unit 2105 for the 
Digital Still Camera is a liquid crystal display (LCD) and preferably the user 
interlace includes devices for entering data (eg, bartons). The communication 
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port 2106 is used to upload one or more, required templates, from a general 
purpose computer 2107, to be stored in the memory storage 21,03. 

Fig. 19 illustrates a schematic representation of a digital still camera 
2202, used in taking a picture of the subject matter 2201 . As a part of the digital 
still camera 2202 there is a LCD 2203, in which the image to be recorded is 
displayed. A user can elect to record the image by pressing shutter button 2206 
or can enter a template mode by pressing a mode template button 2204. The user 
is allowed to exit the template mode by pressing the mode template button 2204 a 
second time. 

Turning now to Fig. 20, upon pressing the mode template button 2204 a 
list of available templates 2301 is displayed on the LCD 2203. In this example, 
the templates include a Landscape template, a pan shot template and a portrait 
template, having been previously uploaded as described above. A selector 
button 2205 is used to navigate through the available selections, and select the 
desired template. . A selection arrow 2302 displayed on the LCD 2203 indicates a 
current template mode selection. 

Once a selection of template is made, for example selecting the Portrait 
template, the image displayed oh the LCD is analysed by the processing unit 2104. 
The results of the analysis are used by the template to guide the user. In this 
example, the portrait template requires that for best results the subject matter 2201 
should be centred and occupy at least a predetermined percentage of the visible 
area of the display (ie, image to be recorded). 

Referring now to Fig. 21, there is shown the LCD 2203 after the Portrait 
template has been selected. A number of elements appear on the liquid crystal 
display 2203 including a positioning indicator 2401, a line up marker 2404 and a 
centre marker 2405 which would not appear on a photograph (or recorded image), 
should the user desire to take a record of the image by pressing the shutter button 
2206. Preferably, details of the current status of the positioning indicator 2401, 
the line up marker 2404 and the centre marker 2405 are generated and included as 
metadata, and associated with the corresponding image, for later use or evaluation. 
For example, if the user has not correctly aligned the relevant markers 2404, 2405 
and for rationing indicator 2401, and the content collecting unit is capable of 
gathering a larger view of an image than is desired, then the information part of 
the metadata, relating to the markers 2404, 2405 and the : information of the 
positioning indicator 2401, can be used to evaluate a preferred print area for the 
image* The image can then be cropped to a predetennined print area. 
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Preferably, the image and corresponding metadata is first downloaded to 
a general purpose computer which is used to edit the image, if necessary, before 
cropping the image to the predetermined print area and ©inputting to the output 
device (eg. printer device). 

The positioning indicator 2401 can advise the user to use another 
orientation, such as a vertical orientation of the camera 2202, by flashing on and . 
off a peripheral arrow 2402 on the indicator. The position indicator further 
provides zoom advice to the user." A "zoom in* arrow 2403 indicates that it is 
desirable to zoom in on the subject 2201 of the image, Accordingly, a "zoom 
out" arrow 2406 can flash to indicate that it is desirable to zoom out. Alternately, 
the subject 2201 or the camera 2202 can be moved closer together or farther apart 
to achieve a substantially similar effect as a zoom in or zoom out respectively. 

The centre marker 2405 and the line up marker 2404 are provided for a 
variation on the first enhanced gathering apparatus in which the enhanced capture 
device 2100 is capable of analysing the content information of the image and « 
substantially detecting an approximate position of the subject 2201 in the image. 

The detection of the approximate position of the subject of the image 
need not be performed by analysing the content information and can be 
determined by other techniques. For example, the position of the subject in the 
image can be determined by detecting which portion of the image a user is 
looking at from a relative position of the user's eye pupils in relation to the image 
being observed. 

In this variation of the first enhanced gathering apparatus, the centre 
marker 2405 is placed at the centre of the visible area, while the line vp marker 
2404 is placed at the centre of a . detected subject. Since the line up marker 
attempts to follow the subject 2201, a user can rnanipulate the line up marker 
2404 and centre marker 2405 by moving the camera" 2202 to align the markers. 

As illustrated in Fig. 22, the user preferably rotates the camera 2202 into 
the desired vertical orientation so that the peripheral arrow 2402 no longer flashes 
on, indicating a correct orientation. At this stage, as illustrated in Fig. 22, the 
markers 2404, 2405 do not necessarily align, the subject 2201 does not occupy a 
predetermined portion of the image and the "zoom in" arrow 2403 is still 
indicating thata zoom in is desired. 

Referring now to Fig. 23, the user has centred and zoomed in on the 
subject matter 2201 of the image correctly, which results in all the arrows on the 
position indicator being off and preferably an indicator 2602 of alignment also 
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appears on the LCD 2203. By not indicating any further desired changes to the 
zoom or orientation, the position indicator is suggestive that the composition of 
the image (photograph), in accordance with the chosen, template, is correct in 
zoom and orientation and that the current image (photograph) is recommended for 
recording. - The user activates the shutter button 2206 to record the image. 

Referring to Fig. 24, there is shown a further example of the Digital Still 
Camera operating in portrait template mode where the subject of the image 
comprises more than one object The template attempts to optimise a best fit of 
the objects onto a visual area of the image. Preferably, a geometric centre of a 
bounding box containing the objects is used as an align marker 2702 location and 
a geometric centre of the visual area of the image (ie. visible display area 2203) as 
a centre marker 270L Further, since one of the objects appears partly outside the 
visible display area 2203, the position indicator recommends, by flashing on the 
zoom out arrow 2406, that a zoom out is desirable. 

A substantially similar description applies to the landscape template and. 
the pan shot template where the landscape template is generally used for 
photographing landscape scenery and the pan shot for panoramic wide view shots. 
For the sake of brevity and clarity, the templates have been described as providing 
a small number of features such as orientation, zoom, etc. in which the template 
can provide advice to a user. However, the template is not limited thereto, For 
example, one or more templates could provide the user with advice on features 
including desired lighting for a photograph, best angle for lighting in a 
photographic studio type setting, and camera focus advice to improve composition 
of a photograph. The camera focus advice can be by way of suggesting a camera 
setting to achieve a background focus and foreground defocus. The templates 
attempt to provide advice to the user, from content information available to the 
templates, which could otherwise be provided by one skiUed in the art of 
photography. For example, advice on preferred orientation, best zoom and 
positioning of subject matter to provide guidance to the amateur photographer 
who is typically not abreast of the required skills to produce a quality photograph 
or a photograph of a redetermined style 

Templates are implemented in code with the use of a programming 
language as previously described. Pseudocode for a portrait template is included 
in the accompanying Appendix A The main routine of the pseudocode executes 
and runs while the digital still camera is powered up and analyses an image in the 
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viewfinder <LCD 2203) to check for various conditions that arc used to detect 
which of the available template features are optimum. 

When Ae user has pressed the template mode selection button 2204 the 
available templates are displayed. The user can select a desired template, with 
the selector button 2205 and then exit the template selection mode. Upon 
making a selection, a software routine, such as that represented by the pseudocode 
contained in Appendix A, checks for various conditions that are required for zoom 
and orientation of the image in the viewfindcr. 

The sub routine SetUpForTemplate returns a TRUE Boolean value when 
the image is aligned and the main program "Void MainO" will flag that the image 
(picture) is aligned. 

As previously described, additional information such as metadata can be 
recorded and associated with an image. Examples of this additional information 
include date, time, actual zoom used, shutter speed, aperture, that the still is a 
portrait of a person, the number of people in the shot and the centre of each face 
detected in the shot as well as the geometric centre of all the faces detected. 
Second Enhanced Gathering Apparatus 

As described hereinafter, a second enhanced gathering is substantially the 
same as the first except that the enhanced capture system 2104 forms part of a 
video camera. Templates are provided capable of providing advice on features 
including zoom, pan, composition and directing (in the sense of a film direction) 
of a video clip. For example, a plurality of uploadable templates can be provided 
to a user, for uploading into the video camera, including templates for directing a 
wedding scene; a real estate agent* s home selling promotional clip; and a country 
holiday scene which may include suggestions as to sights and wonders of the 
world that are recommended for video recording. For instance, the user may be 
going on a holiday to Egypt and taking a video camera comprising an enhanced 
capture system 2104. To enhance the composition of a video recording, which 
will be taken while the user is in Egypt, a template of preferred sights of North 
Africa can be uploaded to the enhanced capture system 2104. Besides 
performing the other function herein described, the template may further suggest 
recommended sights and wonders worth video recording (eg. the Pyramids). 

As a further example, reference is made to an uploadable template for 
directing a wedding scene (hereinafter a wedding template). A user desires to 
make a video recording of a relative's wedding; the person calls up on a general 
purpose computer a wedding template and uploads it to the video camera, 
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comprising'the enhanced capture system 2104, via the communications port 2106. 
Hie wedding template is stored as (compiled) code in the memory storage means 
2103 while generic features to uploadable templates have been previously stored 
in ROM 2108 at, for instance, manufacture of the video camera-enhanced capture 
device. The generic features may include details of maximum and minimum 
zoom settings available, aperture settings possible and other features that may be 
common to a majority of templates for the video camera, 

When the user sorts to record a wedding scene using the video recorder, 
the wedding template is activated and advises the user as to the shots the person 
must take in order to produce a video clip, which upon editing if necessary, 
complies to a substantially professional video recording. For example, the user 
is prompted, preferably in chronological order, with shots that provide a desired 
wedding scene composition. That is, the user is prompted to take a shot of the 
groom entering the church, the groom standing at the alter, the bride leaving the 
car and making her way up the steps of the church, the bride walking down the 
aisle and so on. Further, the -user is also advised on technical video issues such 
as zooming, panning, lighting and audio. For example, if when taking the shot 
of the bride walking down the aisle, the user zooms too fast on the subject, a 
"slow down* indicator is flashed in the viewfLnder of the video camera and a too 
slow zoom is equally signalled to speed up the zooming. 

Preferably, a user indicates through a series of menu driven cornmands- 
displayable on a viewfinder (LCD) which section, or portion the user is currently 
video recording. The user ricks off (selects) the section that is to be, or has just 
been, video recorded. . For example, in the wedding template, the user is given a 
display of a multitude of sections, or portions, which is recommended for 
videcing including the aisle section, when the bride is walking down the aisle. 
The user ticks off the aisle section before or after recording the reJevant scene. 
Data associated with the "ticking ofF of a section is recorded as metadata for the 
corresponding portion of the video clip. For example, information that a portion 
(section) of the wedding scene is the section where the bride walks down the aisle 
is recorded as part of the metadata to the wedding scene. At editing of the 
recorded wedding scene, preferably by an external device such as a computer 
adapted to edit video clips, the metadata associated with the wedding scene can be 
used to identify various sections of a wedding scene. 
Third Enhanced Gathering Apparatus 
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A third enhanced gathering apparatus is described with reference to a 
sound mixing desk comprising enhanced capture device. A sound mixing desk 
is typically used for gathering musical content from a number of different 
channels, applying various effects and filters to individual and/or groups of 
channels, then combining these channels into one or more output channels that are 
then recorded, or used to drive amplifiers, for an audience. 

Again for the sake of simplicity, a simple two-channel interface sound 
mixing desk is described. The mixing desk is implemented using a computer to 
display controls, analyse the content, with the aid of filters, analysers, effects units 
and alike hardware assistance, provide a user feedback and send control signals to 
the filters and effects units. 

Referring to Fig. 25, there is shown a sound mixing desk system 2800 
comprising: a plurality content gathering sensors 2801 such as sound transducers; 
an enhanced gathering device 2802 capable of supporting multiple channels; a 
general-purpose computer system 2804; a plurality of effects units, filter banks 
and analysers 2810; an output amplifier 2809 with at least one output port 2811; 
and playback devices 2812 including compact disk CD player, reel to reel tape 
and/or cassette tape unit. 

Information gathered by the sensors 2801, and the other peripheral 
devices 2812 is passed to the enhanced capture device 2802 which processes the 
gathered information according to a selected template. A desired collection of 
templates is uploaded to the enhanced gathering device 2802 by a data (omnibus) 
link 2805 to be stored in a memory storage unit of the device 2802. While the 
type of content gathering sensors may vary from implementation to 
implementation, the enhanced gathering device 2802 comprises substantially the 
same components as illustrated in Fig. 18. In the present example of a sound 
mixing desk 2800, a user interface unit of Fig. 18 is excluded, preferably, in 
favour of an external display 2813, keyboard 2814 and mouse 2806 device. 

The information gathered by the sensors 2801 and other peripheral 
devices 2812 form part of the content informatioa The content information 
preferably includes metadata such as time, date, recording duration length, 
musical style and thle of track, which may be added to the content information by 
a selected template. Although a plurality of templates .arc uploaded to the 
enhanced gathering device 2802, a single template selection can be made by a 
user through manipulation of a mouse and/or keyboard device driven menu 
displayed on the display device 2813. The information gathered is directed, via 
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a communication link 2803 between the enhanced gathering device 2802 and the 
plurality of effect units, filter banks and analysers 2810, to the output amplifier 
2809 and output pert 2811 for use. Content information is passed to the 
computer 2804 through the omnibus link 2805, and data about content 
information is displayed for the user on the display device 28 1 3. Preferably, the 
content information is further analysed by a central processing unit which extracts 
data to be displayed Alternatively, the content information is analysed by the 
enhanced gathering device and only relevant display data is transmitted via link 
2805 to the computer 2804. 

The user is allowed to interact with various settings through manipulation 
of the input devices 2806 and 2814. The various settings arc conveyed on a bi- 
directional link 2807, as control signals, to the amplifier 2809 and to the plurality 
of effect units, filter banks and analysers 2810 that are designed to alter 
parameters of effects, filters to produce desired modifications to the information 
output on 2811. The bi-directional link 2807 preferably also carries signals 
generated by a number of de vices, including the plurality of effects units, filter 
banks, analysers 2810, the output amplifier 2809 and the playback devices 2812, 
relating to a current status and/or playback content information of the various 
playback devices 2812 if required 

A user can alter preference and default settings through the computer 
system 2804. The default settings are generally dictated by the type and/or 
combination of components connected at a sound mixing desk. For instance, 
different choices of transducers or playback devices may require different default 
settings. Preference settings generally provide a manner of customising a sound 
mixing system to user preferred settings. Both preference and default settings 
are stored in non-volatile memory, generally part of the computer system 2804. 

An example of an uptoadable template is described below with reference 
to a band mix template. A band mix template provides advice to a user, of the 
sound mixing system, associated with sound mixing (and if desired recording) of 
musical bands, including such band styles as a String Quartet, a Rock and Roll 
band, a Heavy Metal band and a Classical Orchestra. At selection (and 
execution) of the band mix template, the user is prompted to tick off (select) a 
music style of the band, a size of the venue (ie small hall, putdoors, studio etc). 
Preferably, the user is further prompted to identity which channels (or associated 
sensors) are to used to gather information (sound signals) for instruments and 
which sensors arc for vocals. The band mix template then produces a 
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recommended list that provides best allocation of available microphones (sensors) 
for cad channel. 

Further, the user may select a test run ("dry run"), upon which the band 
mix template can analyse the content information and advise on which sensor is 
picking up reflections off surrounding objects, and either nominate a solution (eg. - 
re-allocate the microphones or rc-position the sensors) or attempt to electronically 
compensate for the distortion through the effects and filters available. Similarly, 
if the band does a dry run of a performance in the correct order, a sound level 
setting can be determined and used as a guide for an eventual performance. 

As data (information) is collected by the sensors 2801, the enhanced 
gathering device 2802 perforins content Information extraction and provides this 
content information to the computer 2804. Preferably, from the derived content 
information, the computer2804 sends compensation control signals, for the 
sensors on each channel, to adjust the filters (graphics equalisation), on each 
channel. The computer 2804 further sends control signals that adjust the effects 
and also fine tune the filters on each channel to all the instruments in a band, to 
conform with the music style of the template. 

For example, a user can select a Heavy Metal music template with a high 
distortion level to the vocal channel. Boosting of the top end frequencies is 
recommended to the user of the mixing desk and preferably these features are 
adopted automatically unless the user desires otherwise. 

However, if the user selects a Classical music template, then all the 
channels are biased to a sound level setting to be as flat as possible. That is, no 
(special) effects, through the effect units and/or filter banks, are added to 'the 
channels so that instrument sounds are reproduced as closely as possible to a true 
sound of the instrument 

As previously described the template provides advice to the user which 
could otherwise be provide by one skilled in the art In the present example the 
art is the art of sound mixing, for example advice on echo, sound reflection, 
reverberation, tempo are at least some features that a.sound engineer would advise" 
on when recording and sound mixing. 

Whilst only briefly described with reference to the second enhanced 
gathering apparatus, an optional preferred feature of thejtemplates applicable to 
each of the above described apparatus is that of providing a check list of events ex- 
actions that a user can tick off (select) in respect of predetermined events or 
actions. For ifistance, in the digital still camera example described above, a 



(80) 

check list of predetermined shots is provided to a user through the user interface. 
Before (or after) the user takes a shot (photograph), the user ticks off a 
corresponding predetermined shot from the check list. Tor example, the digital 
still camera is uploaded with a birthday party template which includes a birthday 
parry check list The check listls displayed on the user interface and the check 
Kst may include, by way of example, the following: 

* birthday party games shot; 

* blowing out of the candles shot; and 

* . making a toast to the birthday person shot 

The user takes photographs of the birthday party and if the photograph 
taken coincides with a shot described on the "check list - the user can tick ofT- 
(mark or select) that a pi^etennined photograph described in the check list has 
been taken. Accordingly, at ticking off a selected shot from the check list, 
metadata is generated and associated with the photograph (or image). This . 
metadata information can be utilised, for example* when the photograph (or 
image) is downloaded to a general purpose computer, to put together a photo- 
album of the birthday party, 

A plurality of check lists can be provided with each template that can 
assist the user in determining which photographic shots would make good 
composition when putting a photographic album together. 

In the example of the sound mixing desk, a substantially similar check 
list for music can be provided where a user ticks off the check list once an event 
(eg, musical piece, mixing characteristics) described in the list is performed. 
Again, corresponding metadata is generated and associated with the event The 
corresponding metadata can be a simple identifier for the event or a more complex 
description of the event as may be desired for future manipulation or editing of the 
event. 

Referring now to Fig. 26, there is shown another example of a check list 
displayed on the user interface display (eg. viewfinder 2203 of the digital still 
camera of Pig. 19 or the viewfinder of the video camera of the second enhanced 
gathering apparatus hereinbefore described). The check list 2900 is associated 
with a real estate template which can be uploaded (load) into the enhanced gather 
capture device 2100 as previously described with reference to the first and/or 
second enhanced gathering apparatus. The real estate template advises a user 
(typically a real estate salesperson), of the digital still camera or the video camera 
on composition and/or images required to compose a good presentation. The 
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real estate* template can, as an optional function, provide a real estate check list 
2900 comprising: description fields 2901 which provide a brief description of a 
recommended photograph (or video clip in the case of the video camera), to be 
recorded; check list indicator fields 2902 provided foi marking off each 
corresponding image (photograph) recorded; and check list marker 2903 to 
indicate which of the recommended images have been recorded 

The check list marker 2903 is typically added by the user, through an 
available user input interface (eg, buttons), preferably when the recommended 
image has been recorded. The real estate template, upon checking off the items 
of the check list, generates metadata and associates the metadata with the 
corresponding image of the check list. Preferably, the metadata is an encoded 
description of the corresponding image to which it is associated. „ Further, the 
metadata can include such characteristics as time, date, location etc. 

Referring to Fig. 27, there is illustrated a block diagram of bfonnation 
flow from an enhanced capture (gather) device 21000 to a computer system 21001 
comprising uploadable templates 21002 and subsequently to an output device 
21003. A plurality of templates 21002 are uploaded, via a bi-directional 
communication link 21005, typically from a computer system 21001 comprising a 
set of templates 21002. 

Content information 21006 is gathered by the input devices 21000, and 
metadata 21007 is generated by at least one of the uploaded templates 21004. 
The generated metadata 21007 can be as simple as a description of the content 
information determined by a user response to a check list and/or determined from 
the template by analysis of the content information 21006. The generated 
metadata 21007 is associated by the template to a corresponding part or all of the 
content information 21006. For example, in the case of the real estate template - 
the content information may comprise an image from a recommended check -list 
2900 of images suggested by the real estate template. The corresponding 
metadata generated for the image can be based upon features including: content 
analysis directed to orientation, average colour, average brightness, dominant 
colours, predetermined patterns, statistical analysis in spatial, time or frequency 
domains identified in the content information; user preferences including colour, 
arrangement of information; and device specific features including a current state 
of hardware components, predetermined formatting of information for 
downloading to various output devices. 
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The enhanced gathered information, which includes content information 
and metadata is downloaded to an external device. In the present example, the 
external device is a general purpose computer system 21001 as previously 
described. . ... , . 

However, the external device can be a dedicated external device capable 
of receiving the enhanced gathered information. Such dedicated devices include; 
a printer device, a display device (eg. cathode ray tube, CTR, Liquid Crystal 
Display (LCD)), a photocopying devioe, and/or an acoustic recording device, each 
of which have been adapted to receive the gathered information and provide an 
output or storage of the information according to predetermined preferences. 
The external device can be, for example, a video cassette tape for recording and 
storage of the enhanced gathered information to be used at a latter stage in 
composing a final output 

Preferably, an uploaded template 21004 formats and arranges the 
enhanced gathered information in accordance with predetermined setting or 
formats the enhanced gathered information depending upon the type of external 
device to which the enhanced gathered information is to be downloaded to. ~ 

The process of enhancing gathered information may be practiced as 
software, readable and executable by a processing device such as a 
microprocessor, recorded on a computer readable recording medium. The 
recording medium includes magnetic and optical storage memory such as a hard 
and/or floppy drive, magnetic tape, CD-ROM, magneto-optical disk, a memory 
card, read-only memory, etc. FurtheT the software may be resident on another 
computer system accessed through a Network system or across the Tntemet 

Examples of enhanced gathering devices that may be used in 
implementations of the present invention include the following digital .video 
camcorder devices: . 

SONY VX-100Q (Sony Corporation, Japan); 

SONY PC-10 (Sony Corporation, Japan); 

PANASONIC NV-DS5 (Matsushita Electric Corp, Japan); 

CANON MV1 (Canon Inc^ Japan); and 

CANON XL1 (Canon Inc. Japan). 

These devices provide for the generation of a limited set of metadata 
relating to recorded audiovisual information. Such metadata typically relates to 
rudimentary identification of the information. More advance devices include 
the; 
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KOPAK DC220, 260 (Kodak Corp>, ySA); and 
MINOLTA Dimage EX Zoom 1500 (Minolta Corp., Japan), 
both of which arc still image digital cameras and may generate higher level 
-metadata, for example corresponding to the "real estate" embodiment described 
with reference to Fig. 26. 

The foregoing describes only some embodiments qf the present invention, 
however, modifications and/or "changes can be made thereto without departing 
from the scope and spirit of the invention. 

APPENDIX A 

Pseudocode 

. // Portrait Template 
Boolean SetUpForPortrart(Boolean ULFIagsQ. image) 
{ 

Boolean Result = TRUE 

// Assume only called IF 0 < numFaces Detected '< A 

IF IndequateMargir^roundGeometricCentre{image) THEN 

ULFIags[ZOOMJ)U7] - TRUE 

Result = FALSE 
ELSEIF ToMuchMarginAroundGeometricCentre(lmage) THEN 

UI_Flags[ZOOMJN] = TRUE 

Result * FALSE 

ENDIF 

IF ((FacesBoundingBoxTallerThanltlsWlde(Jmage) AND 
CameraOrientation Equals LANDSCAPE) OR 
(FacesBoundingBoxWidererThanitlsTall(image) AND 
CameraOrientation Equals PORTRAIT)) Then 
UI_Flags[CHANGE_ORIENTATIONJ « TRUE 
Result = FALSE 

ENDIF 

IF (FacesBoundingBoxCentred(image) EQUALS FALSE THEN 
ULFLAGS[CENTRE_BOUNDINGBOX] = TRUE 
Result = FALSE ~ 

. ENDIF 



} 
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RETURN Result 



VoidmainO - ...... 

Boolsan UIRags(CONST_NUM_UI_FLAGS) 
ImageType image 
TemplateType templateSelected 

WHILE PoweredOn 

IF MenuButtonPressedO Then - 

tempIateSelected = DisplayAvailableTemplatesO 

ENDIF 

// Get the image that the camera Is looking at 
GetlmagelnViewfinderflmage) 

// Check for cases for which there is a template 

IF templateSelected EQUALS CONST PORTRAT TEMPLATE 

THEN 

IF SetUpForPortrait{UIFIags, image) EQUALS TRUE 

THEN 

UIFIags[PICTURE ALIGNED] = 
TRUE . - i 

ENDIF 
ELSEIF 

Other checks for other templates 

ENDIF 

UpdateUI(UIFIags) 
END WHILE 

} - 



4 Brief Description of Drawings 
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Notwithstanding any other forms which may fall within the scope of the 
present invention, preferred forms of the invention will now be described, by way 
of example only, with reference to the accompanying drawings, in which: 

1 is a * c kemafle representation of an overview of an apparatus in 

ac^ro^ce* w^ 

Fig. 2 is a block diagram of a sample input scrip! of multimedia elements 
generated in accordance with the preferred embodiment; 

Fig. 3 is a flow chart of a beat synchronisation process in accordance 
with me preferred embodiment; ~ ~ 

Fig. 4 is a flow chart of a transition generating process in accordance 
with the preferred embodiment; ~ ' 

Fig. 5 is a flow chart of an overview of an editing process in accordance 
with the preferred embodiment; 

Fig. 6 is a flow chart a portion of editing process of Fig. 5 in more detail; 

Fig. 7 illustrates an example of beat synchronisation between multimedia 
elements in accordance with the prefened embodiment; 

Fig. 8 illustrates an example of audio level editing in accordance with the 
preferred embodiment; 

Fig, 9 illustrates an example of a zoom sequence fwrning part of a visual 

element; 

Fig. 10 illustrates an example of a pan sequence forming part of a visual 

element; 

Fig. II represents an image derived from ^stitching together, the pan 
sequence of Fig. 10; 

Fig. 12 represents a salient still image derived from a compositing of the 
200m sequence of Fig. 9; 

Fig. 13 represents motion vectors of two video sequences indicating a 
motion when the video sequences are rendered to a display device; 

Fig. 14 represents an example of a transition between video sequences 
(segments); 

Fig. 15 shows an example of an image and overlay graphics _TITLE 
wherein a colour of the overlay graphics is chosen in accordance with the 
preferred embodiment; ' 

Fig. 16 illustrates an example of likely areas of interest for extracting 
colour content information from an image; 
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Fig. 17 is a schematic representation of a computer system used to 
implement the preferred embodiment; 

Fig. 18 is a block diagram representing an overview of an enhanced 
gathering device; 

Fig. 19 is a representation of Digital Still Camera, comprising the 
enhanced gathering device of Fig. 18; 

Fig. 20 illustrates a "Template selection' mode of the Digital Still 
Camera of Fig. 19; 

Fig. 21 illustrates. composition features, "Orientation Guidance" and 
"Alignment", of the Digital Still Camera of Fig ; 19; 

Fig. 22 illustrates another composition feature, "Zoom Guidance", of the 
Digital Still Camera of Fig. 1 9; 

Fig. 23 illustrates an example of an enhanced image composition; 
Fig. 24 is an example of a viewfinder display for a portrait of more than 
one person in the image; 

Fig. 25 is a Hock diagram of an alternate enhanced gathering device; 
Fig. 26 is an example of a check list associated with a template; 
Fig. 27 is a block diagram of infonnation flow for the enhanced 
gathering devices; and 

Fig. 28 is a flow diagram of the process of enhancing gathered 
information. 
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1 Abstract 

A method of fonning a media production from source media including at least one 
of audio media and visual media is disclosed the source media is received and 
analysed to extract therefrom content information associated with a 
corresponding element of the source media. The content information is 
examined for at least one of the elements to determine a limited set of production 
rules applicable to the corresponding element The user may the selectively 
imply at least one of the rules to a corresponding one of the elements so as to alter 
the corresponding .element,- for example in duration, synchroaicity with other 
elements etc. The altered element is then combined at least with other of the 
media to form the media production. 
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